-- Logs begin at Mon 2022-07-25 04:49:31 UTC, end at Mon 2022-07-25 06:06:39 UTC. -- Jul 25 05:31:10.559592 dv-cinder-850831-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 05:31:10.570697 dv-cinder-850831-1-smb devstack@keystone.service[86769]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:31:10 2022] *** Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: nodename: dv-cinder-850831-1-smb Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: machine: x86_64 Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: clock source: unix Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: pcre jit disabled Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: detected number of CPU cores: 4 Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: current working directory: / Jul 25 05:31:10.572742 dv-cinder-850831-1-smb devstack@keystone.service[86769]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: your processes number limit is 47680 Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: your memory page size is 4096 bytes Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: detected max file descriptor number: 2048 Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: lock engine: pthread robust mutexes Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: thunder lock: enabled Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 05:31:10.573375 dv-cinder-850831-1-smb devstack@keystone.service[86769]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:31:10.618031 dv-cinder-850831-1-smb devstack@keystone.service[86769]: Python main interpreter initialized at 0x55e6692869c0 Jul 25 05:31:10.618031 dv-cinder-850831-1-smb devstack@keystone.service[86769]: python threads support enabled Jul 25 05:31:10.618031 dv-cinder-850831-1-smb devstack@keystone.service[86769]: your server socket listen backlog is limited to 100 connections Jul 25 05:31:10.618031 dv-cinder-850831-1-smb devstack@keystone.service[86769]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:31:10.618342 dv-cinder-850831-1-smb devstack@keystone.service[86769]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:31:10.618415 dv-cinder-850831-1-smb devstack@keystone.service[86769]: *** Operational MODE: preforking *** Jul 25 05:31:10.618649 dv-cinder-850831-1-smb devstack@keystone.service[86769]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:31:10.618649 dv-cinder-850831-1-smb devstack@keystone.service[86769]: spawned uWSGI master process (pid: 86769) Jul 25 05:31:10.618848 dv-cinder-850831-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 05:31:10.619900 dv-cinder-850831-1-smb devstack@keystone.service[86769]: spawned uWSGI worker 1 (pid: 86778, cores: 1) Jul 25 05:31:10.619900 dv-cinder-850831-1-smb devstack@keystone.service[86769]: spawned uWSGI worker 2 (pid: 86779, cores: 1) Jul 25 05:31:10.619900 dv-cinder-850831-1-smb devstack@keystone.service[86769]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:31:16.094974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:31:16.094974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: from cryptography.utils import int_from_bytes Jul 25 05:31:16.096349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:31:16.096349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: from cryptography.utils import int_from_bytes Jul 25 05:31:16.096463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:31:16.096463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: from cryptography.utils import int_from_bytes Jul 25 05:31:16.096887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:31:16.096887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: from cryptography.utils import int_from_bytes Jul 25 05:31:16.145671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:31:16.145879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:31:16.146072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] command line args: [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:31:16.146165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:31:16.146291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:31:16.146368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:31:16.146491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] command line args: [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:31:16.146573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ================================================================================ {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:31:16.146746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] admin_token = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.146829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:31:16.146976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ================================================================================ {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:31:16.147060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] config_dir = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] admin_token = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] config_source = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] debug = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] config_dir = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.147755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] config_source = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] debug = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.148971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_config_append = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_dir = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_file = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.149965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_config_append = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_dir = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_file = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.150925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.151931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.152983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] publish_errors = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.153925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.154975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] standard_threads = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] publish_errors = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.155974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] use_journal = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] use_json = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] use_stderr = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] use_syslog = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.156926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] standard_threads = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.157045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.157045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.157251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.157360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.157482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.157601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.157734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.158354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.158498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.158752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.158879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] use_journal = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.158992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.159102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] use_json = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.159250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.159423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] use_stderr = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.159539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.159721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.159837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] use_syslog = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.159947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:31:16.160250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.160987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.161917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.162768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.163898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.164845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.165988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.166878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.167978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.168967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.169929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.170991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.171940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.172995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.173091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.173185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.173299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.173418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.174937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.175889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.176929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.177917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.178947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.179890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.180904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.181899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.external = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.182959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.password = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] auth.token = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.183908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.184918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.185979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.186902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.187907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.external = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.188941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.password = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] auth.token = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.189994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.190935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.191983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.192953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.193995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.194831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.195981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.196882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.197903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.198946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.199886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.200910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.201940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.202954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.203893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.204695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.205290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.205290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.205511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.205751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.205886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.206925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.207916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.208948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.209985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.210900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.211955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.212993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.213906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] role.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] role.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.214925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.215978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.216904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.217887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.218908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.219966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.220079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.220191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.220312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.220981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.221955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] role.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] role.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.222967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.223715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.224896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.225924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.226950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.227884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.connection = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.228934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.229978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.230893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.231979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:31:16.232318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.232774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.233016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.233268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.233522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.233757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.234007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.234308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.234579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.connection = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.234831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.235086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.235354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.235602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.235846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.236115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.236359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.236686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.236941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.237187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.237437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.237680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.237935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.238179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.238429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.238666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.238914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.239183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:31:16.239363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:31:16.262371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.262597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.262819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.265297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.265536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.265768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.271839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.274743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.300407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.300634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.301568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.301806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.443728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.443993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.493683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.493913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.494432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.494671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.558294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.558521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.558744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.558960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.559958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.560168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.584740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.584974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.585934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.586068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.586148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.586285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.597294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.597762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.610929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.611624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.611740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.611819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.611893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.611965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86779) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.612037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.612037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.612174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:31:16.629126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.629330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:31:16.629659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.629741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.629854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:31:16.629936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:31:16.630120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:31:16.630630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.630964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.631158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.631425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.641991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.642891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.643987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.651582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.652167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.654853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.655163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.655497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.655579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.655783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.655876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.656987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.657794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.658056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.658328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.684235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.685270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.685833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.686111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.686901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.687219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.692080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.692356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.692633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.693075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.693359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.693643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.699893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.700172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.701006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.701292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.705299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.705801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.705929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.706212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.706483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.706629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.706756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.706919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.707022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.707228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.707325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.707515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.707789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.708066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.708337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.708608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.726281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.726552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.727698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.727981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.731208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.732549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.734897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.735211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.736442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.736739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.740242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.741797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.743896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.745462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.747664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.747958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.748251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.748535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.748805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.749076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.749283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.749596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.749897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.750197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.750480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.750761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.769111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.769474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.769740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.770000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.770925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.771333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.771605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.771873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.777889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.779626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.779849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.779967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.781570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.781850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.783003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.783415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.783694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.783973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.784255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.784996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.785282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.785566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.785846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.786129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.797548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.797824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.798101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.798377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.798689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.798980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.799282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.799615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.799897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.800191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.800471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.800764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.801052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.801331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.818872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.821655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.822153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.824989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.825464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.827051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.828349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.828706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.828982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.829272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.830508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.832199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.832482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.832775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.837224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.838845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.840351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.842104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.842198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.842440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.842724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.842998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.845398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.845695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.846000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.846265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.852781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.853018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.853294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.855792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.856080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.856362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.861302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86779) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.861586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.861868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.862139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.862406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.862679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.862949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.863243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.863517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.863781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:31:16.864571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86779) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.864952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.865192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.865466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.865748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.866033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.866308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.866590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.866873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.867174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.867445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.867712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.867983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:31:16.903963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6692869c0 pid: 86779 (default app) Jul 25 05:31:16.906952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6692869c0 pid: 86778 (default app) Jul 25 05:31:16.907320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dafad4-ab0a-4e6a-8e48-309e410294d5 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:16.907609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dafad4-ab0a-4e6a-8e48-309e410294d5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:16.907964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dafad4-ab0a-4e6a-8e48-309e410294d5 None None] PATH_INFO: `/v3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:16.912180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Jul 25 05:31:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:24.712404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:24.712933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:24.712933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:24.717173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:31:24.723241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:24.723654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:24.723799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:24.793432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: INFO dbcounter [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] Registered counter for database keystone Jul 25 05:31:24.814407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG oslo_db.sqlalchemy.engines [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:31:24.820633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writer thread running {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:31:24.997009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG passlib.handlers.bcrypt [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86779) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 05:31:24.997347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG passlib.handlers.bcrypt [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86779) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 05:31:25.052717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:25.054352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:25.175021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 05:31:25.328981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:25.400093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: INFO dbcounter [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] Registered counter for database keystone Jul 25 05:31:25.419246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:31:25.426069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writer thread running {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:31:25.545039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff8dc-5bb1-42f9-8730-f559ba1d9b93 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:25.549901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:25.550569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:25.550858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:25.551154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:25.559328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:25.612701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 05:31:25.612978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ecc0-159f-42fb-bb4b-5e626be1bbf9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:25.622660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 25 05:31:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:31:25.628752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:25.643092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e2f0e-9bc5-43bf-8e68-968b7466b2eb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:25.647472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:25.648593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:25.648879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:25.649157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] PATH_INFO: `/v3/projects/cf14668381bc465f992daab174b77fd4` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:25.653261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] RBAC: Authorizing `identity:get_project(project_id=cf14668381bc465f992daab174b77fd4)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:25.704150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 05:31:25.704498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83166-db04-4bf3-b764-75fafcd852ff admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:25.709143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Jul 25 05:31:25 2022] GET /identity/v3/projects/cf14668381bc465f992daab174b77fd4 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:27.729792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0757-c20d-41aa-a6bd-8aa18dd16ee5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:27.730284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0757-c20d-41aa-a6bd-8aa18dd16ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:27.730284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e0757-c20d-41aa-a6bd-8aa18dd16ee5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:27.734344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:27.740142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:27.740566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:27.740713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:27.759366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:27.760890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:27.769408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 05:31:27.791828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0757-c20d-41aa-a6bd-8aa18dd16ee5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:27.803818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e0757-c20d-41aa-a6bd-8aa18dd16ee5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:27.807950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:27.808577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:27.808860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:27.809138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:27.816913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:27.818676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b7b70-2c00-404b-ae7a-cda69e1c011b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:27.827384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 25 05:31:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:31:27.833299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:27.842257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bda0f-614d-4411-baa5-0f5730a6fb52 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:27.847401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:27.848265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:27.848553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:27.848837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:27.850497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:27.852374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50b221-fa7c-4924-98c6-3d4bacd68b1f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:27.853951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Jul 25 05:31:27 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:29.947493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1a42-0d4c-4550-b6e9-104368144aff None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:29.948032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1a42-0d4c-4550-b6e9-104368144aff None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:29.948032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c1a42-0d4c-4550-b6e9-104368144aff None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:29.949406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:29.954625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:29.955164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:29.955378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:29.958548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d05b-0474-4ef9-94d4-83da06a417ac None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:29.958838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d05b-0474-4ef9-94d4-83da06a417ac None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:29.959118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d05b-0474-4ef9-94d4-83da06a417ac None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:29.960467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:31:29.965293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:29.965574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:29.965847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:29.971933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:29.973176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:30.005981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG passlib.handlers.bcrypt [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86778) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 05:31:30.006416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG passlib.handlers.bcrypt [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86778) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 05:31:30.051900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:30.053488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:30.054704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:30.078547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.102505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.153252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:30.176658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.181639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f8f8-4a5c-408f-93ce-ab6e1bff4c19 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.215018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.215784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.216068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.216346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.228079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:30.239933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:30.240844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:30.241644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:31:30.247018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.275261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4506-b99a-4b82-82be-d5fa246a7469 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.277531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.312457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.313355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.313644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.313989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.329497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.348817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4f41-117e-4ac5-a77d-ce9c749e3f20 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.382622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.383329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.383614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.383881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.383984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.384631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:30.384939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.386333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.398111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:30.403589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.485172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:31:30.491118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.493819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.501035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1793-451a-4df6-96ca-a55a51dc31c1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.535590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.536472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.536759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.537035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.538239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.539760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.541569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:30.546646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.561198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.588342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fdb6d-0c3a-4568-aa88-1d6b33616c4d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.623104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.623932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.624219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.624493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.643464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.644921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.646612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346a16f-6db9-42c2-81b8-9f9af4cb09a9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:31:30.666742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:30.667693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:30.673777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:31:30.673777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:31:30.673777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:31:30.673777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:30.673777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:31:30.674475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.679705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.680508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.680786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.681059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.682230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.683720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.685324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:30.691142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:30.736220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.769752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:30.780137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4931c2-1395-4dd1-a93f-1a65e3948535 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.789287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657689e0-e6b0-41e9-b1a3-c392a8cd0c02 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:30.816454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.817114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.817397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.817672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.818398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:30.818705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.820128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15b3c-36d3-4cfd-a753-b4e983f73f93 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.822793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:30.823476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:30.823759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:30.824462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:30.825305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.domain.id=default, user.id=07b3e7435f2b475f9f928da267cae759) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:30.825619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:30.827039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391c64f-ebcb-4be1-89de-2a3e14bbedd8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:30.835426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/role_assignments?user.id=07b3e7435f2b475f9f928da267cae759&scope.domain.id=default&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:30.837918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:33.013067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcad1-5150-4e8a-8975-7312ed2d89dd None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.014082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcad1-5150-4e8a-8975-7312ed2d89dd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.014563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcad1-5150-4e8a-8975-7312ed2d89dd None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.016181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:33.022303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.023108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.023602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.047403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:33.049188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:33.136318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:33.167021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dcad1-5150-4e8a-8975-7312ed2d89dd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:33.309249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dcad1-5150-4e8a-8975-7312ed2d89dd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:33.361948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:33.362760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.363046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.363354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.381999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ecda3fdc-1416-461b-908a-a789f132e6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:33.389782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:33.390609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:33.391406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 13/24] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:33.398840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:33.493879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:33.494749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea239e-4d85-42fa-b74c-b17ba837db35 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.495045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea239e-4d85-42fa-b74c-b17ba837db35 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.495349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea239e-4d85-42fa-b74c-b17ba837db35 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.497453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 14/25] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:31:33.505493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c5b-2976-421f-b71e-448c17542521 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.506043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c5b-2976-421f-b71e-448c17542521 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.506577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d2c5b-2976-421f-b71e-448c17542521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.531172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:33.543927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d19d2c5b-2976-421f-b71e-448c17542521 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:33.545542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d19d2c5b-2976-421f-b71e-448c17542521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:33.562605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f102b78-789b-4242-a2b1-2248632ffc93 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:33.625131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:33.625843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.626133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.626492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.627365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:33.627682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:33.629140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f954a-c78f-4db2-84bb-764f1808bde1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:33.662543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 12/26] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:33.663965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b936f2f-51fb-4c31-baa4-ced6588c265c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.664257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b936f2f-51fb-4c31-baa4-ced6588c265c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.664547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b936f2f-51fb-4c31-baa4-ced6588c265c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.670892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:33.672456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b936f2f-51fb-4c31-baa4-ced6588c265c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:33.689161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:33.690590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.690891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.691203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.727284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:33.728498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:33.841771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b936f2f-51fb-4c31-baa4-ced6588c265c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:33.859479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:33.863098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:33.864306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:33.930619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:33.932934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:33.933840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:33.934126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:33.934405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:33.940313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:33.941795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:33.943798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 14/30] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:33 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:33.944564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:33.981898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2e58-7a7a-4fd8-b814-7795f58a5675 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.031467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.033307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.035450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.035933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.051190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.053061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:31:34.074990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:34.075954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:34.077130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:31:34.077130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:31:34.077130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:31:34.077130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:34.083093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 17/31] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:34.083093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:34.110426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054148-4043-49e2-94f7-c7df1f1e5d8b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.157210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.159663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.160151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.160604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.161559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.163188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.196611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66377f9-e0ef-44cb-a7d1-effe346b8993 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.215702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.237981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.239071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.239615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.240109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.241477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.243298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd65e83-a51e-4f9f-8a7d-da40def7cb9b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.245607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 18/32] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:34.247161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918c57-0641-4726-8ebc-caca922c253a None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.247672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918c57-0641-4726-8ebc-caca922c253a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.248121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918c57-0641-4726-8ebc-caca922c253a None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.249803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 19/33] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:34.250705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918c57-0641-4726-8ebc-caca922c253a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:34.307101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 15/34] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 05:31:33 2022] POST /identity/v3/roles => generated 219 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:34.308429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:34.377599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918c57-0641-4726-8ebc-caca922c253a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.413369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.427160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.428074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.428457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.428837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.429714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:34.430796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.432806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470877b5-6529-450e-8c71-be7044a54d4a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.456350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 20/35] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:34.462809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.463408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.463801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.484395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:34.486151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:34.551479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.578704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ed4ad-8fe8-4e11-a153-ed20e4771ae8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.591517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 21/36] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:34.592864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:34.619165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.620185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.620479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.620768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] PATH_INFO: `/v3/domains/default/users/07b3e7435f2b475f9f928da267cae759/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.624501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07b3e7435f2b475f9f928da267cae759, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.626092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.651452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 16/37] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Jul 25 05:31:34 2022] PUT /identity/v3/domains/default/users/07b3e7435f2b475f9f928da267cae759/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:34.652027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:34.757150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabe44-d9b7-41a8-b0a8-6b5213bea92b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.797588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:34.800286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.801217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.801417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.802015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.802491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.803954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.805745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52496f7-afe6-4d7a-b303-e42f708edd58 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:34.848424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:34.849363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.849655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.849939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.850753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:34.852188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59eef1-ad4a-413c-8dff-11ff63322c80 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:34.866763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 17/38] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 05:31:34 2022] POST /identity/v3/roles => generated 225 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:34.868379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894baa2-c15b-49fe-8843-d18bc3a61bc6 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.869206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894baa2-c15b-49fe-8843-d18bc3a61bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.869206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894baa2-c15b-49fe-8843-d18bc3a61bc6 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.870591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 18/39] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:34.871824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3a88-1d14-4eb6-bd26-a7c2d276ecbc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.872163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3a88-1d14-4eb6-bd26-a7c2d276ecbc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.872488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3a88-1d14-4eb6-bd26-a7c2d276ecbc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.873829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 19/40] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:34.875722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc40f7-fbfb-4606-8af8-f20db76f90e9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.876012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc40f7-fbfb-4606-8af8-f20db76f90e9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.876961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc40f7-fbfb-4606-8af8-f20db76f90e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:34.897203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3abc40f7-fbfb-4606-8af8-f20db76f90e9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:34.898861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3abc40f7-fbfb-4606-8af8-f20db76f90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:34.988164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:34.989878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:34.990387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:34.990888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:35.010806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:35.012539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:35.088479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:31:34 2022] POST /identity/v3/projects => generated 301 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:35.095457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:35.097122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:35.123855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:35.137218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:35.167960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:35.244556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ddec9-56d9-489d-ba9a-48352586e449 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:35.265860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f582b-9b6b-4bc6-a47f-8abad2ce44e6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:35.285285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:35.285975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:35.286241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:35.286529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:35.287314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:35.288831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:35.307766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 05:31:35 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:35.315806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:35.316741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:35.317093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:35.317439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:35.318808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:35.320982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd25f7-280a-4943-9a7a-b683d7ffead1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:35.322538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:35.328371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:35.436007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:35.454243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2636e-bcec-4f64-8c9a-31d8746b7232 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:35.495681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:35.496278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:35.496560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:35.496835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:35.497559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:35.499027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2472e-69ee-4927-aa2c-75b886b6c0d3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:35.528932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:31:35 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:31:36.771849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254365-70d0-4efb-ac2d-a304429e370d None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:36.772334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254365-70d0-4efb-ac2d-a304429e370d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:36.772334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254365-70d0-4efb-ac2d-a304429e370d None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:36.773712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:36.779108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:36.779552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:36.779701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:36.797020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:36.798632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:36.864110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:36.887492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254365-70d0-4efb-ac2d-a304429e370d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:36.970523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:36.987552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254365-70d0-4efb-ac2d-a304429e370d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.021395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.022239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.022475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.022758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.034093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:37.042884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:37.043850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:37.044890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:37.049970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.117355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:37.152810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705fe54-6e63-43e4-bb88-38d7ca0bb3de None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.185677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.186352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.186638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.186918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.187707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:37.188019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:37.190046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:37.198187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:37.203751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.303923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00bd4b-fb7f-44aa-92ba-5969911ab2de None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.445157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.446026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.446310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.446589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.447784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:37.449231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:37.450885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:37 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:37.456426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.554318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341db731-aff0-4bd3-af0e-5e7ee4100b04 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.581995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:37.588107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.588909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.589195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.589475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.590652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:37.592148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b171e0-11ad-49dd-bee6-5111af190fd4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:37.593801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 27/52] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:37.600580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.616814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:37.632482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd94b7-a61b-491a-a0b7-3740019c3c8b None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.632774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd94b7-a61b-491a-a0b7-3740019c3c8b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.633058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd94b7-a61b-491a-a0b7-3740019c3c8b None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.634578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 28/53] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:31:37.639090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.639405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.639686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.656553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:37.658875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:37.703484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c15a3-dab7-4d0b-a891-f2fc82edda4b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.726481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 29/54] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:37.738897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.739675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.740035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.740390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.741303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.domain.id=default, user.id=07b3e7435f2b475f9f928da267cae759) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:37.741629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:37.743333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:37.750473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.751900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 25 05:31:37 2022] GET /identity/v3/role_assignments?user.id=07b3e7435f2b475f9f928da267cae759&scope.domain.id=default&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:37.855829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0943-8eb5-404e-878d-bb1558f08f03 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:37.884637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:37.893613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:37.894433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:37.894717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:37.894999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:37.896229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:37.897712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b4382-64fb-4d57-b4d4-80b6dbe10c19 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:37.899396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 30/56] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:37.905166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:37.984208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:38.013700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7c7e-a22a-413a-8612-9e6f3aa92cb5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:38.046254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:38.046921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:38.047234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:38.047520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:38.048834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:38.050290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4573-b97e-4187-a27b-792fc1d36b12 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:38.076076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 27/57] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 25 05:31:37 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:40.098629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f55f8-0b73-4f25-ba9a-0f36678d5450 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:40.099437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f55f8-0b73-4f25-ba9a-0f36678d5450 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:40.099531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f55f8-0b73-4f25-ba9a-0f36678d5450 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:40.100843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:40.105871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:40.106269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:40.106438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:40.123672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:40.124873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:40.189652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:40.213560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f55f8-0b73-4f25-ba9a-0f36678d5450 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:40.312868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f55f8-0b73-4f25-ba9a-0f36678d5450 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:40.346339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:40.347154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:40.347455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:40.348196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:40.348951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:40.350623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d10e-79c6-47ec-85aa-d6f8ad9080c1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:40.352286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:40.357701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:40.413996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:40.455322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e6592-f9e2-45dc-b96b-ddbf4701fab6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:40.489443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:40.490109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:40.490397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:40.490682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:40.491430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:40.492892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b657f-72ac-4e14-b898-f36e1013b9c4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:40.518130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:31:40 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:43.772144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd66f-bd98-4403-96d7-093249d69e63 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:43.772635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd66f-bd98-4403-96d7-093249d69e63 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:43.772635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd66f-bd98-4403-96d7-093249d69e63 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:43.774034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:43.779558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b47e0-eda9-469e-8583-93fb05a4e2da None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:43.780270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b47e0-eda9-469e-8583-93fb05a4e2da None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:43.780270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b47e0-eda9-469e-8583-93fb05a4e2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:43.808159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a81b47e0-eda9-469e-8583-93fb05a4e2da None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:43.809375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a81b47e0-eda9-469e-8583-93fb05a4e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:43.909259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 30/63] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:43.944958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dd66f-bd98-4403-96d7-093249d69e63 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:43.989051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2dfef-424f-42c1-a73f-01bb5d0b1bc1 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:43.989418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2dfef-424f-42c1-a73f-01bb5d0b1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:43.989619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2dfef-424f-42c1-a73f-01bb5d0b1bc1 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:43.991030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 31/64] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:31:43.996298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee292c-a713-42ff-babf-6c197833b86a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:43.996595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee292c-a713-42ff-babf-6c197833b86a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:43.996857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee292c-a713-42ff-babf-6c197833b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.019149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9eee292c-a713-42ff-babf-6c197833b86a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:44.020354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9eee292c-a713-42ff-babf-6c197833b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:44.051193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.080495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.103842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dd66f-bd98-4403-96d7-093249d69e63 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.108091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:44.109607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892af5-70ce-4184-9172-8e0d397aa294 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.110040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892af5-70ce-4184-9172-8e0d397aa294 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.110558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892af5-70ce-4184-9172-8e0d397aa294 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.112085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 33/66] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:44.133924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7892af5-70ce-4184-9172-8e0d397aa294 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.153667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.154495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.155297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.155590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.170653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-50b513d0-8428-4f6e-95b5-85b65d034c62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:44.180296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:44.181190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:44.182028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:44.183656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 34/67] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:44.184767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.185052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.185329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.206863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:44.208329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:44.254284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7892af5-70ce-4184-9172-8e0d397aa294 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.278250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 35/68] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:44.278932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.297541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.299756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.300500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.301267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.312757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-9f67234d-07c6-4052-b820-5348ca832602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:44.321796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:44.322635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:44.323784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:44.324414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bdb-51a2-4946-bd68-b4880c19bb00 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.324706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bdb-51a2-4946-bd68-b4880c19bb00 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.324925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bdb-51a2-4946-bd68-b4880c19bb00 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.326386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 35/70] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:44.327875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35bdb-51a2-4946-bd68-b4880c19bb00 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.355877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.373198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.402699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624998d-8a11-4ddf-afdc-703512dd7328 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.440213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.440898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.441189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.441479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.442250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:44.442562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:44.444009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:44.445362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35bdb-51a2-4946-bd68-b4880c19bb00 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.452157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:44.452972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.480401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.481222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.481504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.481952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.493300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-0a8c64ed-ce89-440c-a2d1-78bcba74f5ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:44.501399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:44.502246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:44.502987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 36/72] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:44.503804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e80bb-a2c2-4f49-8c6d-09cd90aae4ff None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.504092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e80bb-a2c2-4f49-8c6d-09cd90aae4ff None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.504377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e80bb-a2c2-4f49-8c6d-09cd90aae4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.520284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bc4e80bb-a2c2-4f49-8c6d-09cd90aae4ff None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:44.521477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bc4e80bb-a2c2-4f49-8c6d-09cd90aae4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:44.560572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df520fb-0ca9-47d0-9f70-9aaefad6d5a0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.576402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.588783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 37/73] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:44.590101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45649a-d05d-4c8f-bef8-7fdd4d2b9a92 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.590391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45649a-d05d-4c8f-bef8-7fdd4d2b9a92 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.590840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45649a-d05d-4c8f-bef8-7fdd4d2b9a92 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.592138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 38/74] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:44.596004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45649a-d05d-4c8f-bef8-7fdd4d2b9a92 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.600505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.601420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.601911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.602375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.603345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:44.603845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:44.605418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:44.615469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:44.616287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.622568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.698680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45649a-d05d-4c8f-bef8-7fdd4d2b9a92 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.716469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1edf4-5711-4087-babf-88fdd9fc9858 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.733654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.734544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.734833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.735115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.750394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.751632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.752215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:44.752477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.752760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.753506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:44.753711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c86c8-a55d-42d1-b1ec-39bbdc1270e5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:44.753818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:44.755220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:44.755651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 39/76] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:44.756799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.757095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.757382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.763631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:44.764431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.773744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:44.774989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:44.808675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.843896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:44.852037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.867371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:44.869002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bab87-fdbb-4786-acc1-576c221f113b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.904451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.905256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.905547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.905828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.916172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:44.924434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:44.925282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:44.926109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 39/79] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:44.927683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:44.952583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05184cdc-c2f5-4ab3-a5ac-254bc605c65e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:44.988369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:44.989272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:44.989553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:44.989833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:44.991022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:44.992521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:44.994157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:44.994912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.026041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.029243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df497e-f849-47b4-bbb8-b6e77ce40451 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.062462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.063107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.063423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.064303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.078413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.098164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cd255-03c5-4f76-8293-296a17feb892 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.131667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.132544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.132830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.132953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.133110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.134319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.134438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.135819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.137493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:45.138245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.229896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.234041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:45.234850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.239073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0be9-5665-4509-b8c5-82d78239aa6c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.271773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.272563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.272847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.273125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.274289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.275787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.277637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 43/83] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:45.278164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.296076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.342778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c70eb-4633-4b5d-b060-011d6c1635ba None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.378364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.378969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.379286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.379572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.380321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:45.380634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.380757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0193b-6c23-4955-b3c3-241685fc7116 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.382032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.390175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 41/84] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:45.390801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.416026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.416684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.416971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.417254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.454744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.486364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.487945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.494410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3930-0578-426e-9a99-ddbd3f338c28 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.505622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.528926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.529580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.529868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.530149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.588259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:45.589289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.598644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.600429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.658577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.690579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72fd8-baec-43ed-8d48-18a634fb3d09 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.698551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:45.699384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.707244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.725428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.726305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.726592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.726879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.728106 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.729553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.731442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 45/87] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:45.732144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.810543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e055ff8-0168-4505-8863-7a2aa7108923 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.831093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b75db-0d6d-4d15-81a8-503cda0d8a4c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.844654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.845872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.846162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.846442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.847182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.848646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.864735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:45.865602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:45.865888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:45.866168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:45.867543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:45.869202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:45.871051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 46/88] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:45.871845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.875841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 43/89] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:31:45 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:45.877352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:45.899482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.936712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:45.993156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aba6c-abb0-490d-b766-650a4fdaaa7d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:45.994715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b17d0-bfb0-4829-af73-376a8e2ec7ea None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.034221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.035103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.035419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.035702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.037979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.039552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.039804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.041040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.041040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.041214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.041285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:46.042040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:46.042402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.045718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.045718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:45 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:46.046312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:46.152377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:46.169336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21081e5-cab4-458d-ae18-ebe995f74d89 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.174159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb8b4-193b-4f5c-949c-80b3527bee85 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.197110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:46.212871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.213774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.214068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.214346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.215534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.216206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.216494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.216775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.217621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:46.217938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.221459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.228960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 48/92] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:46.230090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:46.350842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.352569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.445143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59929-e98a-40ca-9772-7d2b96eadb74 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.515485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.516080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.516369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.517273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.518319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:46.518642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.525072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.527913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:46.537010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 49/93] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:46.539171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:46.562801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 45/94] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:46.569335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:46.597723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:46.693993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d849-b0f8-465b-b1e1-148b85f5849f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.762028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.762716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.763009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.763335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.764528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=07b3e7435f2b475f9f928da267cae759) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:46.764854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.766611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.773656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87fbaa-b0d6-49cd-a3e7-456bdd7dbad8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:46.779520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 50/95] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/role_assignments?user.id=07b3e7435f2b475f9f928da267cae759&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:46.856002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:46.856918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:46.857201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:46.857479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] PATH_INFO: `/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:46.864166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b5286cf6ff4a899e3607e4bbc65b4e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:46.865707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa6cb7-667f-4ed8-b181-2f5c86360113 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:46.867626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 46/96] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:46.873969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:47.018217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e62098-2464-4b56-82b6-9657f745faf5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:47.035602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:47.067869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:47.068555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:47.068846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:47.069131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:47.069986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=f8b5286cf6ff4a899e3607e4bbc65b4e, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:47.070305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:47.071812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d202876-82c7-4c64-9e2c-11bd6f00b54d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:47.078333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 51/97] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:46 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=f8b5286cf6ff4a899e3607e4bbc65b4e&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:48.839688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d968-3b65-4fc0-a2fd-496992979e2e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:48.840705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d968-3b65-4fc0-a2fd-496992979e2e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:48.841191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d968-3b65-4fc0-a2fd-496992979e2e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:48.842798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 47/98] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:48.849032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159e1f-fe2f-4c0b-b18e-94100b5c16e5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:48.850139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159e1f-fe2f-4c0b-b18e-94100b5c16e5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:48.850618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159e1f-fe2f-4c0b-b18e-94100b5c16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:48.872152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2f159e1f-fe2f-4c0b-b18e-94100b5c16e5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:48.873694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2f159e1f-fe2f-4c0b-b18e-94100b5c16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:48.961685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 52/99] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:48.966962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb164-ca16-4b18-9c07-b39c63ad0f94 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:48.967497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb164-ca16-4b18-9c07-b39c63ad0f94 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:48.967976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb164-ca16-4b18-9c07-b39c63ad0f94 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:48.969547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 48/100] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:48.975768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:48.976321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:48.976796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:48.995081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:48.996609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:49.001848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deb164-ca16-4b18-9c07-b39c63ad0f94 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.114358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:49.138220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 53/101] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:49.192553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deb164-ca16-4b18-9c07-b39c63ad0f94 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:49.201344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.271528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:49.291860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:49.292690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.292982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.293265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.294482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:49.295995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33e57-249e-420d-9b71-54174c22648f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:49.297651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 49/102] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:49.304548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4ba3-94cc-47c6-a82a-9df49d732239 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.305015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4ba3-94cc-47c6-a82a-9df49d732239 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.305426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad4ba3-94cc-47c6-a82a-9df49d732239 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.306903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 50/103] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:49.307758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad4ba3-94cc-47c6-a82a-9df49d732239 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.369329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfd0b7-9f9b-4651-9f7e-b93fc7e58607 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:49.405400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:49.406551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.407055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.408224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.419873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-807c0d39-8ca4-4fdb-bc8b-c97de89307be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:49.428445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:49.429368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:49.430108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:49.432534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:31:49.433981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.434474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.434945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.452995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:49.455346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:49.537024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad4ba3-94cc-47c6-a82a-9df49d732239 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:49.557503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 55/105] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:49.558800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.566486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:49.583346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:49.584586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.585062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.585515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.586401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:49.588574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca5018-4181-4ed0-8245-716b9c656c56 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:49.606755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:49.620808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 51/106] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:31:49 2022] POST /identity/v3/projects => generated 302 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:49.622425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bcc7-cb8f-46d5-abb0-a0abb33cb923 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.622839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bcc7-cb8f-46d5-abb0-a0abb33cb923 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.623273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593bcc7-cb8f-46d5-abb0-a0abb33cb923 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.625285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 52/107] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:49.629932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bcc7-cb8f-46d5-abb0-a0abb33cb923 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.702283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a60749-ea31-4b99-9a8d-23efef4e3c19 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:49.755638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:49.758185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.759708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.761079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.764172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:49.765373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:49.769361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3478474-0c72-42ba-a2ab-bb0a22ba89b7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:49.773636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593bcc7-cb8f-46d5-abb0-a0abb33cb923 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:49.789763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 56/108] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:49.796947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cddb3-1abb-45a2-8412-295498f129da None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.799495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cddb3-1abb-45a2-8412-295498f129da None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.799978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cddb3-1abb-45a2-8412-295498f129da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.823621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-864cddb3-1abb-45a2-8412-295498f129da None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:49.825155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-864cddb3-1abb-45a2-8412-295498f129da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:49.867440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:49.869961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:49.870428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:49.871640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:49.887766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:49.899294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:49.900243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:49.901028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 53/109] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:49.901714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.928289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 57/110] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:49.930187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cddb3-1abb-45a2-8412-295498f129da None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:49.947740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:49.957180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.036244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f247416-ce58-45c8-923b-5f6873378d98 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.074726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.075582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cddb3-1abb-45a2-8412-295498f129da None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.075703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.075939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.076220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.077460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.080358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.081263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 54/111] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.082057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.122649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.123941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.124232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.124512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.125280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:50.125595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.127265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfae13-1b7f-41c4-a350-5c99d4694b0b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.136125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 58/112] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.137270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427d29-9bd9-474f-a9b8-06d2f89bcdea None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.137565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427d29-9bd9-474f-a9b8-06d2f89bcdea None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.137849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac427d29-9bd9-474f-a9b8-06d2f89bcdea None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.139314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 59/113] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:50.139827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac427d29-9bd9-474f-a9b8-06d2f89bcdea None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.196199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edcbc-f1ce-4397-a179-9b34e9f5e927 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.198228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.236781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.242564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.243426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.243718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.244438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.256593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:50.257346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac427d29-9bd9-474f-a9b8-06d2f89bcdea None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-379453cc-d318-4dd9-9ff8-0a2f9c05c0f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:50.264775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:50.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:50.266419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 55/114] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:50.268688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51501c2-f665-4c30-be0c-0b4d69100d59 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.268688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51501c2-f665-4c30-be0c-0b4d69100d59 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.268688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51501c2-f665-4c30-be0c-0b4d69100d59 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.274222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 56/115] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:50.274222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51501c2-f665-4c30-be0c-0b4d69100d59 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.304520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.305654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.305942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.306224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.307454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.308910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701a77-7be0-4888-bcb6-1dbed46b3eee None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.310823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 60/116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.312011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.312304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.312578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.330046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:50.331301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:50.411369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 61/117] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:50.411369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.411606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51501c2-f665-4c30-be0c-0b4d69100d59 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.451672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.452558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.452846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.453125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] PATH_INFO: `/v3/users/2b761533814b418fa00e9b8f54c61448` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.468067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] RBAC: Authorizing `identity:get_user(user_id=2b761533814b418fa00e9b8f54c61448)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.469542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538988-9684-4125-a389-e6522e38eecf None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.475747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 57/118] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/users/2b761533814b418fa00e9b8f54c61448 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.475747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.475747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.475747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.491675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:50.492877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:50.501639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.509413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.525991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ebe89-ccab-4f62-b47c-262008447618 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.561384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.562075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.562365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.562657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.563990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:50.564547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.565949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.579667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 58/119] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:50.579667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.580259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 62/120] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.581892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.685517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2488-1c25-4f3d-9af6-98e2dc6b14fc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.688916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0ccad-6f54-4a39-94de-9c8e0596c606 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.721970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.722863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.723168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.723449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/40402998d0af4bdca18971d5a96264c2/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.723569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.724633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.724992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.725205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.725699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, user_id=40402998d0af4bdca18971d5a96264c2, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.727120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.733685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.737403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:50.743194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 59/121] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:31:50 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/40402998d0af4bdca18971d5a96264c2/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:50.744287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:50.755782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:50.756706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:50.757502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:50.760947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:50.762695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 63/122] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:50.764207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:50.895521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1191f1-f169-4326-8b7a-e4e6f87bb8c2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.914112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cdd6-e589-4711-a7f9-97ae6be5d4b2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:50.944963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.945544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.946093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.946093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.967750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:50.968648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:50.975155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:50.975155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:50.975155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:50.975155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:50.975155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:50.975540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.044370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.046389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.052257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.062668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.096919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125c8e2-5c0b-46c6-a270-c014126ef91b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.135423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.136737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.136737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.136940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.148972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:51.158121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:51.158979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 65/124] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:51.160196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.176448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 60/125] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:51.178285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.272594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf23d-1805-4f65-86d1-8cb1c1414a1d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.297221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65d44-0975-4f0b-8441-e93056ce1b1a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.305371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.311148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.315701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.316667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.317053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.317437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.318651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:51.319295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.322073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.334937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 66/126] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.336187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.345109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.345986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.346269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.346545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.348203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.350450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.352857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 61/127] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.354279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.451376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd201-ccd3-4c6a-a285-351910c3303c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.486356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae9c79-e13e-4496-a507-fe456b5e11b2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.494953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.495946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.496441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.496917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.497868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:51.498395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.500033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.509856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 67/128] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.511028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.524637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.525232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.525521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.525817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.526999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.528507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.530380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 62/129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.531119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.571877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.579881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.625478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781936-153f-474f-b6f5-fea70e5fd6b1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.636883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322ebd-f1da-4d8d-91f4-deae47b458d9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.662918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.664178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.664671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.665150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.666534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.668243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.670420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 68/130] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.671537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.672662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.674196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.674476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.674828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/40402998d0af4bdca18971d5a96264c2/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.677265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, user_id=40402998d0af4bdca18971d5a96264c2, role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.678548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.693530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 63/131] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:31:51 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/40402998d0af4bdca18971d5a96264c2/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:51.694437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.795026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f0cca-3325-4804-afa8-beac44aef351 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.803853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0db324-2101-49c7-ad73-526452185272 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:51.812061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.821987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:51.840979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.842384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.842802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.843263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.845481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.846127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:51.846941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:51.847261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.847552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:51.847972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:51.848959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=2b761533814b418fa00e9b8f54c61448) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:51.849577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 69/132] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.849878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:51.850589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.851848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:51.858952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 64/133] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/role_assignments?user.id=2b761533814b418fa00e9b8f54c61448&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:51.860127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:51.974685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960ee5-4c9c-430c-9d4e-02c5dde38eee None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.006764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c790d63-44e5-41dd-a74e-f4442d2905fe None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.031075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.032786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.033206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.033594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.036120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.038037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe576ef-ceab-4f2b-b607-4aeb45482a57 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.040518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 70/134] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:52.042208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437592-d0ae-4d3a-8632-95471992b2a2 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.042595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437592-d0ae-4d3a-8632-95471992b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.043282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437592-d0ae-4d3a-8632-95471992b2a2 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.045600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 71/135] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:52.047293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437592-d0ae-4d3a-8632-95471992b2a2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:52.056391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.057488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.057878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.058261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] PATH_INFO: `/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.059701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b5286cf6ff4a899e3607e4bbc65b4e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.061784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f7bf5-95c1-44b5-adfa-d73c51999e75 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.063862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 65/136] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:51 2022] GET /identity/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:52.065260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.065649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.066040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.084435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:52.085939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:52.120847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:52.124060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:52.178860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437592-d0ae-4d3a-8632-95471992b2a2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.179332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 66/137] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:52.180310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:52.217060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.218192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.218637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.219048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/07b3e7435f2b475f9f928da267cae759/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.222132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, user_id=07b3e7435f2b475f9f928da267cae759, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.223848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.238588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 72/138] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:31:52 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/07b3e7435f2b475f9f928da267cae759/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:52.239994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:52.352378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1dab5-5377-4a95-abee-edf7d9795a63 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.366967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4baf0f-f112-4675-8770-e87e5dd41b51 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.392107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:52.409555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.410727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.411240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.411734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.413117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.414933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.417258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.417733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 73/139] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:52.418566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.418815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.419099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] PATH_INFO: `/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e/users/40402998d0af4bdca18971d5a96264c2/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.423499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:52.424835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b5286cf6ff4a899e3607e4bbc65b4e, user_id=40402998d0af4bdca18971d5a96264c2, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.426326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32e36-df3a-474f-9f70-d881dc21e1ff None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.453506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 67/140] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:31:52 2022] PUT /identity/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e/users/40402998d0af4bdca18971d5a96264c2/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:52.544225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337389c-6d69-4331-9340-46528da13ca7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:52.583713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:52.584747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:52.585240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:52.585703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:52.586631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:52.588316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6e674-83e0-4343-95aa-b14a286acb22 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:52.615622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 74/141] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:31:52 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:53.218476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbefe-4a88-4015-8fc7-0a8a4d73040c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:53.218998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbefe-4a88-4015-8fc7-0a8a4d73040c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:53.218998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbefe-4a88-4015-8fc7-0a8a4d73040c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:53.221129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 68/142] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:53.226937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:53.227408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:53.227584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:53.248107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:53.249327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:53.293360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:53.333178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 75/143] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:53.365972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbefe-4a88-4015-8fc7-0a8a4d73040c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:53.406815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:53.494884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbefe-4a88-4015-8fc7-0a8a4d73040c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:53.537241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:53.538425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:53.538896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:53.539423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:53.552431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:53.560449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:53.561324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:53.562070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:53.564995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 69/144] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:53.570864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:53.687293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e92f4-3984-41c8-874e-b2080a0d3373 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:53.724184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:53.725123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:53.725407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:53.725679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:53.726434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:53.726743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:53.728167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:53.737320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 76/145] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:53.742600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:53.837257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:53.850642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999344a-f7cc-4566-8d58-022592cf0366 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:53.890478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:53.892267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:53.892773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:53.893060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:53.894284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:53.895795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:53.897448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 70/146] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:53 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:53.902932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:53.936572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:54.009536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9a6c8-f356-4511-8a38-d0c853a26031 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:54.046215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:54.046872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:54.047176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:54.047462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:54.125011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:54.127063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:54.158450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:54.233292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 77/147] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:54.238934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:54.361141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509da452-450a-49c6-b7dc-ad674b54531b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:54.400814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:54.401615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:54.401903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:54.402188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:54.403434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:54.404905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc7821-7e65-42f7-ae91-53440b66c491 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:54.406819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 71/148] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:54 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:54.412518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:54.537777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73793d9-1518-47af-9a32-209f60862016 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:54.585517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:54.594907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:54.595730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:54.596298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:54.596775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:54.597843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:54.598163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:54.599949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0051d-911a-415a-8aae-77108a05860a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:54.609591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 78/149] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:54 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:55.239698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa4b4-3c06-4473-a4cf-e91c1d869469 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.240207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa4b4-3c06-4473-a4cf-e91c1d869469 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.240280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aa4b4-3c06-4473-a4cf-e91c1d869469 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.241676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 72/150] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:55.247383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13a10-812f-4da3-a023-19c2204cb47e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.247835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13a10-812f-4da3-a023-19c2204cb47e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.247910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d13a10-812f-4da3-a023-19c2204cb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.271828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f3d13a10-812f-4da3-a023-19c2204cb47e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:55.273011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f3d13a10-812f-4da3-a023-19c2204cb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:55.373766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 79/151] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:55.408955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aa4b4-3c06-4473-a4cf-e91c1d869469 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:55.414504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341464-191b-4cd7-90db-626736505d5f None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.414789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341464-191b-4cd7-90db-626736505d5f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.415069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341464-191b-4cd7-90db-626736505d5f None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.416823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 80/152] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:55.423120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.423450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.423700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.444788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:55.445983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:55.450854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:55.616841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 81/153] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:31:55.628410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aa4b4-3c06-4473-a4cf-e91c1d869469 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:55.657389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:55.694832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:55.695681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.695971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.696251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.720571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:55.732964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:55.733844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:55.734612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 73/154] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:55.747648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:55.784366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:55.898478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdef5c-6417-4452-b365-56961d8cfaaa None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:55.923516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:55.943903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61488fdb-fa06-4689-94d6-9a150dc17900 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:55.965751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:55.966795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:55.967274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:55.967690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:55.988903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:55.997537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:55.998375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:55.999388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:56.002417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 82/155] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:31:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:56.009943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.023887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.024580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.024869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.025149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.025911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:56.029008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:56.029008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9663dd2-1735-4055-9079-acada76b2da6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:56.044123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 74/156] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:56.045489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a23f-89d7-4f42-9da9-dd2d12beaa4d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.045781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a23f-89d7-4f42-9da9-dd2d12beaa4d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.046061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a23f-89d7-4f42-9da9-dd2d12beaa4d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.047348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 75/157] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:56.054380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a23f-89d7-4f42-9da9-dd2d12beaa4d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.201483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682e4d8-fbbf-4d97-aae1-a3aa8fe29955 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:56.243383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:56.280033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.280783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.280983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.281259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.282079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:56.283168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:56.284890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e99dfd-d454-4d41-bc1b-f9a3ec96dcd3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:56.308275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 83/158] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:31:56.310380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.310670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.311675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.321673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a23f-89d7-4f42-9da9-dd2d12beaa4d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:56.343678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:56.344990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:56.396480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.397390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.397677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.397957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] PATH_INFO: `/v3/users/2b761533814b418fa00e9b8f54c61448` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.403887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] RBAC: Authorizing `identity:get_user(user_id=2b761533814b418fa00e9b8f54c61448)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:56.405384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:56.407415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 76/159] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/users/2b761533814b418fa00e9b8f54c61448 => generated 289 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:56.408206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.441462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:56.479506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 84/160] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:56.482790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.606574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9aa13-e773-46d8-8df6-5912bb10d251 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:56.681035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.681921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.682200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.682468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.683849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:56.685306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:56.688051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 77/161] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:56.690639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee7a40-8dc1-4888-a664-2cdd9f2484eb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:56.693230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.712793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:56.762481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.763363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.763641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.763913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.765801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:56.772458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382f19b-6ee3-44eb-9a17-5a5d452b20a3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:56.774522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 85/162] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:56.775852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1ed1-494c-4610-b7d6-b5a42ffad203 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.776136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1ed1-494c-4610-b7d6-b5a42ffad203 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.778232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1ed1-494c-4610-b7d6-b5a42ffad203 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.780980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 86/163] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:56.781717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1ed1-494c-4610-b7d6-b5a42ffad203 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.855378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71fdcc-cbe6-44aa-8540-f51dabb39225 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:56.863384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:56.893972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:56.895043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:56.895487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:56.895904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:56.906660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:56.915524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:56.916465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:56.917238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:56.919715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 78/164] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:56.920893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:56.961563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1ed1-494c-4610-b7d6-b5a42ffad203 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.008912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.009578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.009861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.010141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.035571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d3f26-9f62-4077-971b-bd23990cda69 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.071851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.074735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.075922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.076406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.076892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/2b761533814b418fa00e9b8f54c61448/roles/0a30bdad67a94fd08b5af57ef5fff119` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.079612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, user_id=2b761533814b418fa00e9b8f54c61448, role_id=0a30bdad67a94fd08b5af57ef5fff119)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.081255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937090-dcd8-4c0e-8cb9-6084034a1dc0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.096970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 79/165] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:31:56 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/users/2b761533814b418fa00e9b8f54c61448/roles/0a30bdad67a94fd08b5af57ef5fff119 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:31:57.105950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f54-67c6-4112-b83f-027b8296e0b2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.106826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f54-67c6-4112-b83f-027b8296e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.107275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32f54-67c6-4112-b83f-027b8296e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.112360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.115226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99b983-9047-4438-ba6c-c3dcf370b0f2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.122160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.153980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-03f32f54-67c6-4112-b83f-027b8296e0b2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:57.155862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-03f32f54-67c6-4112-b83f-027b8296e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:57.270150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 80/166] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:57.271818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75f9f-3589-45bc-9a32-967b9d8d57de None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.272320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75f9f-3589-45bc-9a32-967b9d8d57de None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.272739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75f9f-3589-45bc-9a32-967b9d8d57de None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.274327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 81/167] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:57.275245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b75f9f-3589-45bc-9a32-967b9d8d57de None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.324167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 87/168] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:57.326325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8917a-2c03-4c9c-9f7d-a001c3a2945a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.326708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8917a-2c03-4c9c-9f7d-a001c3a2945a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.327111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8917a-2c03-4c9c-9f7d-a001c3a2945a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.328640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 88/169] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:57.330704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.331251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.331630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.357254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:57.359293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:57.402073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b75f9f-3589-45bc-9a32-967b9d8d57de None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.440997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.448296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.448976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.449261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.449536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.450291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:57.450599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.452016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.455214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 89/170] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:57.463152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.470393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.472521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 82/171] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:57.473577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.571441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543be7a0-d8fd-4765-b297-b1153f8ca063 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.582605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c3d01-12b5-4a1d-a911-ee97c218aefd None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.607566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.608698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.608984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.609262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.619902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.620768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.620993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:57.621113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.621311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.622503 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.624014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a13d9-e67c-4485-8a8b-be4a2ba1b8ea None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.635272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 83/172] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:57.635272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.635272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.635272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-d01b8659-8589-44ea-9e01-e08a161338f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:57.635651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:57.636680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 90/173] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:57.637629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc8f42-c1a2-473a-a90b-90219cfd2d04 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.638543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc8f42-c1a2-473a-a90b-90219cfd2d04 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.638543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc8f42-c1a2-473a-a90b-90219cfd2d04 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.638543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 91/174] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:57.638543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc8f42-c1a2-473a-a90b-90219cfd2d04 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.655240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:57.656440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:57.710684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.725478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.737561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 84/175] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:57.748415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.752320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc8f42-c1a2-473a-a90b-90219cfd2d04 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.788806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.789677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.789956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.790230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] PATH_INFO: `/v3/users/07b3e7435f2b475f9f928da267cae759` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.791427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3e7435f2b475f9f928da267cae759)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.792878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.794709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 92/176] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/users/07b3e7435f2b475f9f928da267cae759 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:57.800144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:57.858101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd3a9-144e-4eec-9e3c-4a40f6983962 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.897245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.898160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.898450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.898732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.907257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2878f-8476-45c6-802d-d93b9eebc864 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:57.909415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-355066c7-217e-4620-a85f-93080b62f9dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:57.917187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:57.918108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:57.919081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 85/177] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:57.920567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.920567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.920567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.936696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:57.937896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:57.949722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:57.950544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:57.950930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:57.951245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:57.952082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:57.952397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:57.953963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:57.956589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:57.961963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 93/178] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:57.963254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.000384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.033255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 86/179] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:58.039378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.124007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28280d-96b0-4f07-9f88-e533297f31e5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.163365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.164050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.164340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.164634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.165378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:58.166040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.167074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.180952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553734d7-146d-46b4-9113-0a0e3043d96a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.181980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 94/180] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:31:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.184174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.225145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.226023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.226311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.226593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.227870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.229323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.231899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 87/181] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.232697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.260792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.291001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.308355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c646-247c-4d86-baf2-8e0cd6c0c087 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.350586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.351178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a54c42-0a01-4e31-b718-2850090a663f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.351370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.351593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.351896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.387726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.388322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.388604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.388880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.389627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:58.389932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.391355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.403871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 88/182] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.403871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.437320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.439561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.501923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.505955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132965f1-19c5-4854-a438-3d262c599f8a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.519752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.541990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.542800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.543078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.543383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.545399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 95/183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:58.546237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.557465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:31:58.566337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:31:58.567473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 89/184] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:31:58.568312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.655669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112a835-ab5d-4224-bab4-59796324bcba None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.680441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59c9fb-81d2-458e-b4b7-49e065bda866 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.690598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.691603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.691948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.692236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] PATH_INFO: `/v3/users/40402998d0af4bdca18971d5a96264c2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.693454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=40402998d0af4bdca18971d5a96264c2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.694901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.696589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 96/185] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/users/40402998d0af4bdca18971d5a96264c2 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.701683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.721445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.722114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.722395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.722786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.723436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.725186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.732524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.751187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 90/186] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:31:58 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:31:58.751187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.804265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:58.830488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06895b24-a8a5-45c5-bdc2-f932b142e7a2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.872279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.873313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.873657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.874004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.897280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.899451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.900475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd51c-56df-42cd-9826-c704a23b9925 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:58.903309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 97/187] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.904292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:58.951717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:58.952905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:58.953187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:58.953461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:58.955824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:58.957302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:58.959207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 91/188] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:58.959860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.027580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.046699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be907b4-84b2-4fc3-9216-18c48ec841a0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.090892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.097209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.097903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.098073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8efc11-b1d8-456c-9adf-4f63cc884131 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.098168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.098439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.099268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:59.099962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.101445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.115177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 98/189] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:59.116025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.150848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.151710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.152004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.152291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.233341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120172-99cb-4e66-b614-a6a700e846de None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.236241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.238011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.273339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.274003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.274289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.274568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.293991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.363448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.371276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 92/190] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:59.372114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.383565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.386295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.498551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23634-746d-41cd-aab0-9bac73357ebb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.510441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 99/191] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:31:59.515856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.535099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.535802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.536092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.536371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.537216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=07b3e7435f2b475f9f928da267cae759) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:31:59.537532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.538998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82784e-8aed-4d40-a608-9d01fe0d9601 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.545407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 93/192] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/role_assignments?user.id=07b3e7435f2b475f9f928da267cae759&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:59.547410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616446b8-c453-4a09-8c2e-79a016f8c16e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.547747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616446b8-c453-4a09-8c2e-79a016f8c16e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.548205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616446b8-c453-4a09-8c2e-79a016f8c16e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.553657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 94/193] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:31:59.553657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616446b8-c453-4a09-8c2e-79a016f8c16e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.639221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.648562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.704799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616446b8-c453-4a09-8c2e-79a016f8c16e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.747160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f081c66-bf51-4432-92d1-00b0e99713e1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.758867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.760087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.760374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.760651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] PATH_INFO: `/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.762434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b5286cf6ff4a899e3607e4bbc65b4e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.764092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.766739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 95/194] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/projects/f8b5286cf6ff4a899e3607e4bbc65b4e => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:59.771454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.796055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.798362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.798725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.799158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.800485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.802470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbcda9-cb0c-4fc0-aae5-e8cc5b312f17 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.804858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 100/195] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:59.806591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.806881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.808284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.829018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:31:59.831540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:31:59.898461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cba25-132b-422a-a5eb-90ca83ab0b37 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:31:59.911262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 101/196] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:31:59.913620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.930695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:31:59.941979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:31:59.942947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:31:59.943404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:31:59.943758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:31:59.945109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:31:59.946887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:31:59.948767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 96/197] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:31:59.949874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:31:59.967449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.028060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9422b-908e-4a78-83f1-6891dc9d5d1d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.065909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.066669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.066915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17414-5b5b-4dce-a9d1-75cde50e53c4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.067080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.067450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.068360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=f8b5286cf6ff4a899e3607e4bbc65b4e, user.id=40402998d0af4bdca18971d5a96264c2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:00.068745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.070574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.076764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 102/198] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/role_assignments?user.id=40402998d0af4bdca18971d5a96264c2&scope.project.id=f8b5286cf6ff4a899e3607e4bbc65b4e&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:00.077732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.106917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.107867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.108332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.108782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.236610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e1d0-e51f-4dcc-8192-e4fdad659a38 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.246206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.250298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.279649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.279649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.290464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.292728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.293226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.293680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.313629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:00.324798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:00.325692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:00.326473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:00.329583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 103/199] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:00.330554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.419212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 97/200] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:00.420313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.459988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9634-2e82-4954-88ed-4f7052012e43 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.498865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.499891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.500393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.501415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.502447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=82a84b7f9f734e06a1f4ed8b6c326f99) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:00.503025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.504710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.513476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 104/201] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/role_assignments?user.id=82a84b7f9f734e06a1f4ed8b6c326f99&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:00.514659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.553989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.560943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bed42-7f67-41b8-8513-08b7c35e54a8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.579561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.631093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.633309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.633820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.637085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.638095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:00.638632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.642739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.657477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 98/202] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:00.669625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.699876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a285d-31aa-444a-8f50-c51c903e8093 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.762694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.763950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.764531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.765041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.766520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.768370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.771178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 105/203] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:00.780214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.814149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dadd8c-34aa-4ef8-8de5-7ad3a2e4e50d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.864802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:00.865708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:00.865992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:00.866276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] PATH_INFO: `/v3/users/2b761533814b418fa00e9b8f54c61448` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:00.871885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] RBAC: Authorizing `identity:get_user(user_id=2b761533814b418fa00e9b8f54c61448)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:00.873388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:00.875451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 99/204] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/users/2b761533814b418fa00e9b8f54c61448 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:00.882329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:00.931557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:00.949704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd76da2-81a7-4cef-a6a6-3511237cef62 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:00.951542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.020194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.020872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.021157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.021440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.022295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=82a84b7f9f734e06a1f4ed8b6c326f99) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:01.022610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:01.024110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:01.034997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 106/205] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/role_assignments?user.id=82a84b7f9f734e06a1f4ed8b6c326f99&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:01.063292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52ea97-8a66-41d9-9910-d33a5596722e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:01.120018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.120708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.120995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.121276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.197238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:01.198735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957132-76d9-45d2-9be5-4f89698a7ad9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:01.228228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.310796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 100/206] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:01.316192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.323846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c820b-2f3e-48b9-875c-7788936a0df9 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.324467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c820b-2f3e-48b9-875c-7788936a0df9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.324933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c820b-2f3e-48b9-875c-7788936a0df9 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.326757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 101/207] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:01.332780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613bea-99ca-4f57-81f9-ca1e49bc6ba0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.333340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613bea-99ca-4f57-81f9-ca1e49bc6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.333805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613bea-99ca-4f57-81f9-ca1e49bc6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.352111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e1613bea-99ca-4f57-81f9-ca1e49bc6ba0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:01.353462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e1613bea-99ca-4f57-81f9-ca1e49bc6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:01.487992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9eec3-f44a-424f-9eb4-02091e1f6fef None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:01.490982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 102/208] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:01.517304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ac1c-2c33-4047-8634-640efbb0114e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.517647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ac1c-2c33-4047-8634-640efbb0114e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.517933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ac1c-2c33-4047-8634-640efbb0114e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.519402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:01.524378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ac1c-2c33-4047-8634-640efbb0114e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.534986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.535896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.536178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.536456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.537762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:01.539382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5791a-7e39-4688-8ac2-c98acd110300 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:01.541517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 107/210] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:01 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:01.542798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.543080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.543387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.562531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:01.564067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:01.594248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.598631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.650586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 108/211] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:01.650586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.674853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ac1c-2c33-4047-8634-640efbb0114e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:01.710728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.711559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.711932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.712115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.722890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:01.730855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:01.731749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:01.732577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 104/212] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:01.733230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.778881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c31def-9df3-41fb-9510-c16c000819e5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:01.817214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.818277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.818811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.819303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.820524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, scope.project.id=dec3c81dff03421aa77eb1244e6880fb, user.id=2b761533814b418fa00e9b8f54c61448) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:01.821083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:01.822734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:01.830211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 109/213] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:01 2022] GET /identity/v3/role_assignments?user.id=2b761533814b418fa00e9b8f54c61448&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:01.831307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.853571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fee669-72c5-45e7-a1a1-f5f7a1487da2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:01.864592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.877968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:01.918188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:01.919006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:01.919315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:01.919591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:01.923873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:01.925341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:01.931155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 105/214] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:01.948253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:01.960199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050a3aa-1dda-4ab5-a89c-84d1a9c443e5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.006222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.009111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.010739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.011271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.013401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:02.014123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.016752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.028277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 110/215] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:02.034882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:02.132733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e0dc-bb3d-41c8-a3fe-05409b44f0d8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.150686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:02.162151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648c45-442b-4caa-9a6a-f818c7db10aa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.170713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.171681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.172184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.172679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.173577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.175247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.204740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 106/216] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:01 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:02.213614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.214545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.214833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.215115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] PATH_INFO: `/v3/users/c8a32217bd1544cdac74814dc35da28f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.237779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a32217bd1544cdac74814dc35da28f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.239376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.241484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 111/217] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:02 2022] GET /identity/v3/users/c8a32217bd1544cdac74814dc35da28f => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:02.247417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:02.308776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:02.381327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da773ff-c7ca-4d37-853a-3d5b12eaef2c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.416588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.417247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.417581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.417863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.488390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.489870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.531642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:02.595948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 107/218] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:02.601698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:02.711234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14cd9d-87ba-4410-8e45-1b839fcf5292 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.747219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.748431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.748921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.749386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.750831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.752674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbdc2-e430-484b-b6d4-42c68f914054 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.754948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 112/219] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:02 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:02.760986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:02.882438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf7fb-531f-45c6-91b0-d376309b061c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:02.927863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:02.928534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:02.928822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:02.929103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:02.929952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=c8a32217bd1544cdac74814dc35da28f) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:02.930272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:02.931780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e59a0-d253-4bc2-8d91-eafb16cbb230 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:02.937782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 108/220] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:02 2022] GET /identity/v3/role_assignments?user.id=c8a32217bd1544cdac74814dc35da28f&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:03.216711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa852-accc-4a05-9c17-d571bc57c75c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.217312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa852-accc-4a05-9c17-d571bc57c75c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.217811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aa852-accc-4a05-9c17-d571bc57c75c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.219803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 113/221] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:03.225095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.225387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.225671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.237852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:03.243234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b7e6-a5ff-4597-ba55-2a44ad6fc9d1 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.243789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b7e6-a5ff-4597-ba55-2a44ad6fc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.244259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96b7e6-a5ff-4597-ba55-2a44ad6fc9d1 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.245661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 114/222] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:03.251256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.251545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.251828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.252835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:03.254245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:03.274890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:03.276129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:03.296221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:03.372915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 109/223] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:03.401769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 115/224] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:03.413633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:03.434845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:03.554005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20acc1e-5e0e-45f0-a1fc-14915f069992 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:03.598301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:03.599117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.599430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.599974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.605181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:03.628014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:03.628215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad405383-0c95-43c3-8497-9ad0f20297f9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:03.640019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:03.640954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:03.642584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:03.650477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 110/225] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:03.651390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:03.696867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:03.698040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.698696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.699198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.725826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:03.734094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:03.735029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:03.735853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:03.743996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 116/226] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:03.749623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:03.773247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:03.815446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6d7ce-cd64-49b6-9f2f-fd5d2fe25076 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:03.880619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:03.881305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.881590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.881869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.882626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:03.882935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:03.885590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:03.899466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 111/227] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:03.905763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:03.926379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1906f0b-b150-46ea-84c1-fe4fa28a4a63 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:03.984051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:03.984724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:03.985545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:03.985832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:03.986578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:03.986883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:03.989104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.002765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 117/228] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:04.008769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:04.009567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.081125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0ef9-baa7-47f6-850b-aa3c883969f6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.126748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:04.132766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.133651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.133935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.134211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.136206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.142788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.146269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 112/229] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:03 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:04.150278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.180898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e68d9-360f-49ee-bf97-1f6af23dac05 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.220731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.221629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.221919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.222196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.225000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.226469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.228196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 118/230] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:04 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:04.238720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.364854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572f9-d74f-4450-9819-9b8eefe250ac None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.406301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:04.421867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0df23-0419-4089-8db1-7c8de0e0192a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.439889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.440789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.441068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.441392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.442679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.444266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.446171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 113/231] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:04 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:04.451731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.459301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.460183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.460469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.460750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.461966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.463448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.465206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 119/232] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:04 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:04.472634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.476887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:04.582020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853edc2-b732-4b72-bf66-0fd4a3b24968 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.623058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ece4-216a-4c0b-9643-31b32263bed3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:04.661038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.661938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.662215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.662484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/82a84b7f9f734e06a1f4ed8b6c326f99/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.664583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, user_id=82a84b7f9f734e06a1f4ed8b6c326f99, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.664708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:04.665608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.665897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.666146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb0328-8416-4c87-922f-9edf87e5a692 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.666247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/82a84b7f9f734e06a1f4ed8b6c326f99/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.668477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, user_id=82a84b7f9f734e06a1f4ed8b6c326f99, role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:04.669933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e0453-5ab9-4749-afb8-d37d2d1adcf9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:04.694104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:04 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/82a84b7f9f734e06a1f4ed8b6c326f99/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:04.694285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:04 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/82a84b7f9f734e06a1f4ed8b6c326f99/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:04.789613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ae04-24ba-4510-b60e-51f32561c820 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.789967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ae04-24ba-4510-b60e-51f32561c820 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.790167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912ae04-24ba-4510-b60e-51f32561c820 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.791932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:04.800319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d7bf-e2b1-4d00-8023-5f55359b00fc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.800632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d7bf-e2b1-4d00-8023-5f55359b00fc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.800870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d7bf-e2b1-4d00-8023-5f55359b00fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.820332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0d84d7bf-e2b1-4d00-8023-5f55359b00fc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:04.821563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0d84d7bf-e2b1-4d00-8023-5f55359b00fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:04.878875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:04.902851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:04.929778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912ae04-24ba-4510-b60e-51f32561c820 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:04.943650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829be3-32dc-4e76-9326-20db038c9c2f None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.943935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829be3-32dc-4e76-9326-20db038c9c2f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.944379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea829be3-32dc-4e76-9326-20db038c9c2f None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.945968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 116/237] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:04.951622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:04.952123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:04.952635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:04.972688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:04.974412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:05.028862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:05.071796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 117/238] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:05.079896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912ae04-24ba-4510-b60e-51f32561c820 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.107356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.116086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.116901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.117342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.117617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.118842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:05.120375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:05.122366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 122/239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:05.128234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.290162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57fd2-2815-4dca-9961-a3730489f1b9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.293501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8bd0-ced2-4c0f-bfdb-58fb1afba116 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.317060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:05.336888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:05.346113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.346113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.346558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.346734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.347508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:05.349254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:05.375482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 123/240] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:05 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:32:05.381021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.381867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.382222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.382500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.396646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-039b01f0-c958-4296-a6d8-2a50e750598c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:05.404732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:05.405658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:05.406461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 118/241] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:05.413598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.433153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a900-74a2-45cf-8e0d-77091344897b None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.433491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a900-74a2-45cf-8e0d-77091344897b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.433706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a900-74a2-45cf-8e0d-77091344897b None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.435113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 119/242] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:05.452778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.453102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.453332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.500273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:05.501556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:05.549330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d86e-4d28-4df5-a214-dd0c73e45a87 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.591959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee996-490c-42af-8080-0460951424db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.592741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee996-490c-42af-8080-0460951424db None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.593021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee996-490c-42af-8080-0460951424db None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.593300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee996-490c-42af-8080-0460951424db None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.594063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee996-490c-42af-8080-0460951424db None admin] RBAC: Adding query filter params (name=reader) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:05.595016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee996-490c-42af-8080-0460951424db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:05.597401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee996-490c-42af-8080-0460951424db None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:05.607253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 124/243] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:05.613950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee996-490c-42af-8080-0460951424db None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.670539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 120/244] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:05.676456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:05.696200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.746309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee996-490c-42af-8080-0460951424db None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.791064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.792132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.792627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.793012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] PATH_INFO: `/v3/users/f908381142b14fa4a4a00836de617185` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.809741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] RBAC: Authorizing `identity:get_user(user_id=f908381142b14fa4a4a00836de617185)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:05.811330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:05.813512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 125/245] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/users/f908381142b14fa4a4a00836de617185 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:05.822658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.841649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409b0c3-294d-4e3c-9125-e4a7ce7f072e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.843343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:05.884890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:05.886230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:05.886658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:05.887102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:05.903372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:05.914069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:05.914968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:05.915793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:05.919311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 121/246] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:05.926581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:05.961780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37101434-4f58-42db-a506-16ad2b9d3845 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:05.975457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:06.013444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.014626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.015009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.015623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.074320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00964d1-8136-419c-b570-391e2e6d9bfd None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.104532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.107929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.128675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.129372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.129658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.129937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.130701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:06.131011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.132476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.150475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 122/247] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:06.161472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:06.193943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:06.245920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 126/248] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:06.253237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:06.265253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:06.299818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134506af-fb8f-47a5-bf10-4ff357b32dc9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.351199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.352367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.353131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.353604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] PATH_INFO: `/v3/users/c8a32217bd1544cdac74814dc35da28f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.355770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a32217bd1544cdac74814dc35da28f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.357426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.359738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 123/249] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:06 2022] GET /identity/v3/users/c8a32217bd1544cdac74814dc35da28f => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:06.366172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:06.473396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:06.485604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a0f6-a0e2-4875-93a6-07c20c911589 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.514655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875d9d5-25ea-4993-873a-050c0440bd7e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.526556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.527776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.528707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.529188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.530590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.532939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.536386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 124/250] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:06 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:06.542335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:06.604861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.605681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.605973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.606423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.611884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.613408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.615471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 127/251] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:06 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:06.621136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:06.656817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad42c0-0513-4f50-91da-8304104fbe0b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.693825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.695123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.695626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.696121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/c8a32217bd1544cdac74814dc35da28f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.698394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, user_id=c8a32217bd1544cdac74814dc35da28f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.700262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926fe58-0ba3-482c-81a2-dc3ad0c584ac None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.722149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 125/252] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:06 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/c8a32217bd1544cdac74814dc35da28f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:32:06.756831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:06.790341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69e1ae-4983-4cbc-a02a-79a2a7c0ff5f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:06.839974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:06.841002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:06.841485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:06.841957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:06.843009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=f908381142b14fa4a4a00836de617185) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:06.843539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:06.845892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5397-091d-453e-a4ad-a6ef098a7e8e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:06.852976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 128/253] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:06 2022] GET /identity/v3/role_assignments?user.id=f908381142b14fa4a4a00836de617185&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:07.195060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199ae-64e4-4b16-a905-bf576a2ec12d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.196100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199ae-64e4-4b16-a905-bf576a2ec12d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.196586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51199ae-64e4-4b16-a905-bf576a2ec12d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.198263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 126/254] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:07.204496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362409f-bb1f-4db8-a919-417fade83ef1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.205078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362409f-bb1f-4db8-a919-417fade83ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.205562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362409f-bb1f-4db8-a919-417fade83ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.225657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c362409f-bb1f-4db8-a919-417fade83ef1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:07.227251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c362409f-bb1f-4db8-a919-417fade83ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:07.327430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 129/255] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:07.373389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51199ae-64e4-4b16-a905-bf576a2ec12d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:07.399036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:07.505253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51199ae-64e4-4b16-a905-bf576a2ec12d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:07.523253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f31a38-969f-4bc0-a128-c2838db7bc27 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.523544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f31a38-969f-4bc0-a128-c2838db7bc27 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.523811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f31a38-969f-4bc0-a128-c2838db7bc27 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.525442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 130/256] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:07.530407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.530690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.530968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.548033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:07.549018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.549303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.549579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.564540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:07.568203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:07.569402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:07.581499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:07.582410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:07.583244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 127/257] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:07.596442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:07.711503 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:07.728163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ccc34-c3dc-4edf-8dfa-b082440a0170 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:07.731917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:07.748510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 131/258] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:07.767293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:07.768408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.768859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.769318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.770240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:07.770728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:07.772365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:07.782890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 128/259] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:07.788208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:07.791363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:07.898001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1303-aedd-455c-934e-cf42f3c1e642 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:07.945419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:07.946634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:07.947230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:07.947775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:07.960357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:07.967078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd334a-a027-4ec0-8cb3-6c6a384250a9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:07.968841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:07.969789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:07.970660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:07.973062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 129/260] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:07.984051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:07.995455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:08.040965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.041764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.042047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.042324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.044140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.045594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 132/261] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:07 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:08.055832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:08.146870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adda739-1f45-46b8-9f4e-4fc555df092f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:08.187576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:08.192967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.193940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.194419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.194890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.195864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:08.196814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.198596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.208379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 130/262] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:08.216171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:08.244280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafec63b-fe73-49f6-b411-dbd9248e3fb9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:08.309795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.310125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.310461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.310746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.336099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:08.410511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c95e7-4cdd-4df4-a15d-61b41ac0df53 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:08.426393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.428551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.491831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.493092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.493544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.493951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] PATH_INFO: `/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.495365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] RBAC: Authorizing `identity:get_user(user_id=82a84b7f9f734e06a1f4ed8b6c326f99)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.496964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.499217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:08 2022] GET /identity/v3/users/82a84b7f9f734e06a1f4ed8b6c326f99 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:08.508279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:08.551246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:08.608915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 133/264] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:08.614256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:08.732363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d5f2-e1a2-46e1-a144-3928c09fc497 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:08.792204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:08.799720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef4871-e220-4a9e-adf7-ace2bbcf3eaa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:08.806862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.807631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.807925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.808207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.876048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:08.877254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:08.877733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:08.878200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:08.879675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.881362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.883325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 134/265] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:08 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:08.888953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:08.900452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:08.901957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019076a-4ed3-4606-9a70-585dbb824289 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:08.995498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.011660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 132/266] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:09.013263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76ee1-9b75-4281-bccb-ce47e98bc5a1 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.013697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76ee1-9b75-4281-bccb-ce47e98bc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.014325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76ee1-9b75-4281-bccb-ce47e98bc5a1 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.015802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 133/267] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:09.019606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76ee1-9b75-4281-bccb-ce47e98bc5a1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.055209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.087783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02a30-7ecc-4361-b19e-0140d3f387d9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.130325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.130907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.131207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.131487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.132426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=82a84b7f9f734e06a1f4ed8b6c326f99) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:09.132833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.134322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be28e1-5a17-4812-9409-e9d3deb25cf3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.136662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76ee1-9b75-4281-bccb-ce47e98bc5a1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.147612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 135/268] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:08 2022] GET /identity/v3/role_assignments?user.id=82a84b7f9f734e06a1f4ed8b6c326f99&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:09.149175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd77e6-519d-4048-af28-cd994ba0410a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.149466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd77e6-519d-4048-af28-cd994ba0410a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.149743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd77e6-519d-4048-af28-cd994ba0410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.180962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-84dd77e6-519d-4048-af28-cd994ba0410a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:09.182377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-84dd77e6-519d-4048-af28-cd994ba0410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:09.185725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.186653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.186936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.187254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.192138 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.193646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df2d28-8e6a-4fb4-a899-4421f7adc8b6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.195810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 134/269] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:09.200738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a914ec-9fa7-4de2-b8c3-80a6c1602e8c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.200738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a914ec-9fa7-4de2-b8c3-80a6c1602e8c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.200738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a914ec-9fa7-4de2-b8c3-80a6c1602e8c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.200738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 135/270] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:09.204366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a914ec-9fa7-4de2-b8c3-80a6c1602e8c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.294717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 136/271] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:09.302905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.303485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.303933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.341764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:09.351189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:09.398042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.402664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.406473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a914ec-9fa7-4de2-b8c3-80a6c1602e8c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.444279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.445109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.445485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.445848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.447678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=82a84b7f9f734e06a1f4ed8b6c326f99) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:09.448057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.449586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.456336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 137/272] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:09.457074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.463501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 136/273] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/role_assignments?user.id=82a84b7f9f734e06a1f4ed8b6c326f99&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:09.483535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.604528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42ef39-43ae-4e02-8d7f-2dd8083544d9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.638907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec36bf7-e82e-42ed-88d6-e4275643e99e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.642639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.643491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.643775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.644051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.645285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.646783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.653875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:09.654721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.689175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.711794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.713169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.713457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.713734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.729147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:09.739606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:09.740525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:09.741317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:09.742314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:09.748173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:09.771925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100a7a-bb9e-4e53-b4a9-67da88b5bcd6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.779559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:09.814175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.815070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.815378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.815653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.816369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.817827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.847700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 138/276] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:09 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:09.885999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da20522-30d3-4759-bcb6-0207de9c7864 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:09.929696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:09.929879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:09.930123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:09.930374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:09.931462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:09.931782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:09.933486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07e3da-b090-4b76-badf-7c1e0df6cfaf None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:09.944149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 139/277] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:09.949635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.065049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.079869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae644-15ff-4ad9-a499-171f5ed624ad None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.106814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7438b-66ce-42f3-b46b-efb5e8b6efe3 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.107108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7438b-66ce-42f3-b46b-efb5e8b6efe3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.107429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7438b-66ce-42f3-b46b-efb5e8b6efe3 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.108826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 140/278] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:10.114461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b383-ba89-49fd-a18e-e0d2141fb2e6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.114752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b383-ba89-49fd-a18e-e0d2141fb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.115035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b383-ba89-49fd-a18e-e0d2141fb2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.117867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.118773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.119053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.119380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] PATH_INFO: `/v3/users/afc05851687c407081ea8a064af04788` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.133276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5152b383-ba89-49fd-a18e-e0d2141fb2e6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:10.134569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5152b383-ba89-49fd-a18e-e0d2141fb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:10.137380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] RBAC: Authorizing `identity:get_user(user_id=afc05851687c407081ea8a064af04788)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:10.139697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:10.141782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 139/279] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:09 2022] GET /identity/v3/users/afc05851687c407081ea8a064af04788 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:10.147523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.226315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 141/280] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:10.242271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567029-1037-4d14-a175-0881d9fce579 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.242560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567029-1037-4d14-a175-0881d9fce579 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.242838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567029-1037-4d14-a175-0881d9fce579 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.244527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 142/281] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:10.249613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.249918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.250181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.269703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:10.271043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:10.281119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37ec2-3244-4abe-a93b-c47d4ab529d8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.283749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.325471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.326136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.326419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.326694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.327611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, user.id=afc05851687c407081ea8a064af04788, scope.system=all) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:10.327914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:10.329945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:10.338175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 140/282] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/role_assignments?user.id=afc05851687c407081ea8a064af04788&scope.system=all&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:10.339034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.357473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.369993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 143/283] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:10.405805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.499203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e57d7-c585-4125-bbeb-400f23ab0d76 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.559262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.560184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.560475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.560755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.563731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d007b2-3ba6-4449-acb4-935e86120256 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.572612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:10.581690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:10.582608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:10.587845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:10.591025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.617183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.618519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.620152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.620825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.643981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:10.653319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:10.654192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:10.654977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:10.668154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:10.673442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.676831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.737006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.762090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65be8e-624a-49bb-991f-a0a9e45474cc None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.799653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73372478-abbf-428f-a5ed-bcff437b80b6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:10.825375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.826228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.826456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.826741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.827589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:10.827858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:10.829457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:10.838215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:10.839202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:10.839776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:10.840255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:10.841199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:10.841724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:10.843353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:10.848011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 142/286] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:10.855267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.858508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:10.871945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:10.946215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:10.982767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a337f-42e7-43c2-ac10-a0752c569cc5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.055635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.056480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.056767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.057017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] PATH_INFO: `/v3/users/c8a32217bd1544cdac74814dc35da28f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.060530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] RBAC: Authorizing `identity:get_user(user_id=c8a32217bd1544cdac74814dc35da28f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.061931 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.062814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7f86-9588-479c-9168-0476eb1f8425 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.067259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 146/288] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/users/c8a32217bd1544cdac74814dc35da28f => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:11.069245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:11.097009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:11.103489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.104961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.105481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.106016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] PATH_INFO: `/v3/users/f908381142b14fa4a4a00836de617185` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.107937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] RBAC: Authorizing `identity:get_user(user_id=f908381142b14fa4a4a00836de617185)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.109620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.111705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 143/289] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:10 2022] GET /identity/v3/users/f908381142b14fa4a4a00836de617185 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:11.117448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:11.204582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51c0d-d4e1-4247-b663-36726295390d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.239503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:11.244213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.245333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.245680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.246193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.322957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.324550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.409920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712ee5-1c9e-4c0b-a224-12e4abea319f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.437766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 147/290] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:32:11.449355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:11.468728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.469654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.470089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.470367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.472741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.474186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.477359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 144/291] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:11 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:11.481915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:11.531562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:11.570357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:11.588363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cf2b6-f7e4-4b8a-ad2c-17cec5937d40 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.622921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.623933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.624283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.624634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/f908381142b14fa4a4a00836de617185/roles/0a30bdad67a94fd08b5af57ef5fff119` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.627499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, user_id=f908381142b14fa4a4a00836de617185, role_id=0a30bdad67a94fd08b5af57ef5fff119)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.629019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.646676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:11 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/users/f908381142b14fa4a4a00836de617185/roles/0a30bdad67a94fd08b5af57ef5fff119 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:11.716757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb076b7-a1e8-488f-9a68-b5075edf8b94 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.766398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.767314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.767599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.767877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.769157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.770612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79c364-cd65-4609-9dd4-3968c73e520f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.772794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:11 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:11.778677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:11.887334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e44527-8a15-4c2b-b328-1045001415f4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:11.917987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:11.930131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:11.931151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:11.931642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:11.932173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:11.933233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=c8a32217bd1544cdac74814dc35da28f) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:11.933762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:11.935476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3ec66-9125-41c2-87a8-eb90cb4e0a2c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:11.943410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:11 2022] GET /identity/v3/role_assignments?user.id=c8a32217bd1544cdac74814dc35da28f&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:12.417048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4eb1a-6198-4528-9370-1a8cd81be938 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.417567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4eb1a-6198-4528-9370-1a8cd81be938 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.417567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4eb1a-6198-4528-9370-1a8cd81be938 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.418981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:12.424781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc48aa-08f5-4eb7-b35b-0c20295d622d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.425212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc48aa-08f5-4eb7-b35b-0c20295d622d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.425334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc48aa-08f5-4eb7-b35b-0c20295d622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.446206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cadc48aa-08f5-4eb7-b35b-0c20295d622d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:12.447713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cadc48aa-08f5-4eb7-b35b-0c20295d622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:12.536497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:12.560281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4eb1a-6198-4528-9370-1a8cd81be938 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:12.618705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c0d27-82bf-46b3-9980-dc12a8d9a2f9 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.619285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c0d27-82bf-46b3-9980-dc12a8d9a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.619783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c0d27-82bf-46b3-9980-dc12a8d9a2f9 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.621368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 148/297] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:12.627008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.627569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.627928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.645577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:12.646967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:12.666882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:12.673342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4eb1a-6198-4528-9370-1a8cd81be938 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:12.715373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:12.716175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.716470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.716991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.728297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 149/298] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:12.732650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:12.741132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:12.742011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:12.742792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:12.745162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 150/299] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:12.751876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:12.753163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:12.811802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:12.864980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d8c88-a86b-4db7-80e4-8dc2e3714789 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:12.889150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d6d2-d534-476f-80dc-683242559699 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:12.905161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:12.905838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.906117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.906394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.907718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:12.908269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:12.909946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:12.918732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 150/300] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:12.924300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:12.927079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:12.928030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:12.928322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:12.928607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:12.929811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:12.931419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:12.933230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 151/301] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:12.939885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:12.975537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:13.033106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68ff6-8b7c-46ae-a06a-804585575149 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.046760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:13.053268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344abfa-532a-46d2-94d1-bb2fa69ee0c0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.069069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.070153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.070574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.071099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] PATH_INFO: `/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.085779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f019ebef01ba4fd3ac8082b9cb64a9fd)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.087874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c0629-36f4-4949-81e3-45e0c88ed1e8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.089514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.090178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.090316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 151/302] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:12 2022] GET /identity/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:13.090456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.090730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] PATH_INFO: `/v3/groups` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.091446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.092080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb770ee-6663-41f6-87dd-bda96d6f183f None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.092485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb770ee-6663-41f6-87dd-bda96d6f183f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.092864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.093012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb770ee-6663-41f6-87dd-bda96d6f183f None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.094859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 152/303] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:13.101198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.101485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.101762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.112555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 152/304] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 25 05:32:12 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:13.112555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:13.124473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:13.126286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:13.216473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 153/305] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:13.244465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:13.247933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:13.266223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0ab1-c0b3-4569-bb22-a5d54bfb52b7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.308766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.309325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.309612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.309893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.310737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, user.id=f019ebef01ba4fd3ac8082b9cb64a9fd, scope.system=all) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:13.311052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.312547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.320888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 153/306] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 05:32:13 2022] GET /identity/v3/role_assignments?user.id=f019ebef01ba4fd3ac8082b9cb64a9fd&scope.system=all&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:13.372132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9f03-0002-4108-898e-cdd7ec5cbc24 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.373531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:13.414555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.415690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.416181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.416651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.429599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:13.439174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:13.440245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:13.441020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:13.443542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 154/307] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:13.449745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:13.558554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861ff9-d760-4eb9-8563-8b80edfacf5b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.594603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.595725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.596016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.596293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.597048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:13.597357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.598727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.607838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 154/308] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:13.613995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:13.716558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d043fe-9ab1-48c7-8b6b-7a595824c6bf None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.752728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.753958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.754440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.755084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] PATH_INFO: `/v3/users/afc05851687c407081ea8a064af04788` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.756541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] RBAC: Authorizing `identity:get_user(user_id=afc05851687c407081ea8a064af04788)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.758196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd4458-8711-4e48-bd50-29e0f98da177 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.764806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 155/309] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:13 2022] GET /identity/v3/users/afc05851687c407081ea8a064af04788 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:13.766959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:13.785026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:13.872779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac7733-2fdc-4588-811b-9fd09fa81cd5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:13.900528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d8c6-dc81-4bd0-8f51-73d8ca29a179 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.901125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d8c6-dc81-4bd0-8f51-73d8ca29a179 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.901606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3d8c6-dc81-4bd0-8f51-73d8ca29a179 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.903199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 156/310] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:13.909118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.909401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.909671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.911897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:13.913063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:13.913605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:13.914062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] PATH_INFO: `/v3/system/users/afc05851687c407081ea8a064af04788/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:13.916052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=afc05851687c407081ea8a064af04788, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:13.917455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:13.929444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:13.931058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:13.933685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 155/311] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 25 05:32:13 2022] PUT /identity/v3/system/users/afc05851687c407081ea8a064af04788/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:13.971648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:14.025602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 157/312] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:14.049213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:14.144430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:14.171975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2c6c-25c2-42a9-a6bf-2a63f9dbd4d8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:14.207339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:14.208152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:14.208441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:14.208722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:14.219986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:14.227915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:14.228797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:14.229600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 156/313] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:14.236615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:14.339553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51392692-96f0-4805-9312-c2c7f872d6ae None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:14.376585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:14.377353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:14.377641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:14.377920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:14.378677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:14.378987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:14.380398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:14.389373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 158/314] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:14.395526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:14.505762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79b791-7dd6-4af0-9f86-c6253bd3eb34 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:14.541461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:14.542371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:14.542717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:14.543004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] PATH_INFO: `/v3/users/f908381142b14fa4a4a00836de617185` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:14.544314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] RBAC: Authorizing `identity:get_user(user_id=f908381142b14fa4a4a00836de617185)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:14.545796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:14.548130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 157/315] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:14 2022] GET /identity/v3/users/f908381142b14fa4a4a00836de617185 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:14.556236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:14.583508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:14.664079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1797-2289-4a52-9274-e9d2e11158db None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:14.703864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:14.704649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:14.704821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:14.705958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:14.774035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:14.775780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:14.800355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:14.878033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 159/316] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:14.884206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:14.896797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:14.996512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72556a48-12f2-446f-8294-42f091114d86 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.037236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.038112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.038397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.038677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.039888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:15.041323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780537b-612f-4308-9f2b-31da2bb8d200 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:15.043236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 158/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:14 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:15.049317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:15.151564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6408-168b-4151-989b-789d786b1d86 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.174765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:15.186679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.187376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.187655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.188535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.189392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2, user.id=f908381142b14fa4a4a00836de617185) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:15.189754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:15.191396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf956fb-684f-4234-a869-623b00f6dc92 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:15.198799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 160/318] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:15 2022] GET /identity/v3/role_assignments?user.id=f908381142b14fa4a4a00836de617185&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:15.401282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3d04-a560-4047-a448-57357778e753 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.401597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3d04-a560-4047-a448-57357778e753 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.401838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3d04-a560-4047-a448-57357778e753 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.403688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 159/319] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:15.409425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de754-2927-47a0-8c6b-5f9e75cb0bef None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.409715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de754-2927-47a0-8c6b-5f9e75cb0bef None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.409995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de754-2927-47a0-8c6b-5f9e75cb0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.428260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2e6de754-2927-47a0-8c6b-5f9e75cb0bef None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:15.429722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2e6de754-2927-47a0-8c6b-5f9e75cb0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:15.501307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 161/320] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:15.523404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3d04-a560-4047-a448-57357778e753 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:15.525234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f81e-5922-4903-b359-d5b4aaa0a8dc None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.525521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f81e-5922-4903-b359-d5b4aaa0a8dc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.525793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f81e-5922-4903-b359-d5b4aaa0a8dc None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.527429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 162/321] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:15.532436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.532719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.532994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.549946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:15.551106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:15.604195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:15.628116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 163/322] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:15.635874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3d04-a560-4047-a448-57357778e753 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.650451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:15.673179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.674294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.674583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.674842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.676043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:15.677476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:15.679107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 160/323] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:15.684470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:15.706598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:15.765250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9628-f267-461e-917f-9db7f091fdac None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.794101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff58ff-876b-4dd2-a242-28d11a03d65d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.805045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.806147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.806564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.806841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.817867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:15.825519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:15.826610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:15.827575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 164/324] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:15.832863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.833286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:15.833604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.833997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.834281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] PATH_INFO: `/v3/groups` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.835033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:15.836621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:15.853069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 161/325] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 25 05:32:15 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:32:15.951582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8488e9-66f0-40c3-a279-c58c5bb1d59b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:15.959849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:15.991186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:15.991862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:15.992141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:15.992419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:15.993177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:15.993483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:15.994898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cf9a8-0fcc-4aae-afb9-bdaf2ede13cb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:16.005115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 165/326] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:16.011267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.014161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:16.130335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb640b-5e5a-403d-9fb7-da9b9ef774d1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:16.156426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134d07-a813-4f78-89d9-e59985a1ae79 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.157064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134d07-a813-4f78-89d9-e59985a1ae79 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.157346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134d07-a813-4f78-89d9-e59985a1ae79 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.159055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 166/327] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:16.164339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567275-407f-4bd2-b237-bd887e9606be None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.164885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567275-407f-4bd2-b237-bd887e9606be None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.165358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567275-407f-4bd2-b237-bd887e9606be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.180295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:16.181181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.181464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.181742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] PATH_INFO: `/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.182958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] RBAC: Authorizing `identity:get_user(user_id=f019ebef01ba4fd3ac8082b9cb64a9fd)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:16.184447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:16.185952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-17567275-407f-4bd2-b237-bd887e9606be None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:16.186412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 162/328] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:16 2022] GET /identity/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:16.187618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-17567275-407f-4bd2-b237-bd887e9606be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:16.192639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.279313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 167/329] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:16.280560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:16.303969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17567275-407f-4bd2-b237-bd887e9606be None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.318119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430b782-9e0d-4a33-a65d-699cfbb46c19 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:16.366527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:16.367453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.367737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.368015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] PATH_INFO: `/v3/system/users/f019ebef01ba4fd3ac8082b9cb64a9fd/roles/0a30bdad67a94fd08b5af57ef5fff119` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.370248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f019ebef01ba4fd3ac8082b9cb64a9fd, role_id=0a30bdad67a94fd08b5af57ef5fff119)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:16.371702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:16.383044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 163/330] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 25 05:32:16 2022] PUT /identity/v3/system/users/f019ebef01ba4fd3ac8082b9cb64a9fd/roles/0a30bdad67a94fd08b5af57ef5fff119 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:32:16.442884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:16.447406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17567275-407f-4bd2-b237-bd887e9606be None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:16.489095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:16.490108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.490494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.491039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.504977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:16.513254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:16.514797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:16.516846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:16.522807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 168/331] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:16.523109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.632600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fb840-72df-46f2-b89f-c33342bc09f5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:16.668904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:16.669581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.669869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.670150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.670912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:16.671253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:16.673241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:16.674745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:16.689564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 164/332] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:16.690785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.806153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082d74-7329-4790-9064-7aa44fe1defe None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:16.843466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:16.845136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:16.845425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:16.845713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] PATH_INFO: `/v3/users/afc05851687c407081ea8a064af04788` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:16.846946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] RBAC: Authorizing `identity:get_user(user_id=afc05851687c407081ea8a064af04788)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:16.848561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d686fe0-69c9-4727-ae79-2f2d747f8c0a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:16.855025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 169/333] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:16 2022] GET /identity/v3/users/afc05851687c407081ea8a064af04788 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:16.856952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:16.973015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c444-c511-4e2b-9998-664105d39c51 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:17.007323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:17.007994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:17.008283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:17.008557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:17.009395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] RBAC: Adding query filter params (role.id=0c3b8416418f4545a6c4598e12e222eb, user.id=afc05851687c407081ea8a064af04788, scope.system=all) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:17.009709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:17.011483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1ab8b-eb87-4b0e-ab30-bffb15c5f645 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:17.026322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 165/334] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 05:32:16 2022] GET /identity/v3/role_assignments?user.id=afc05851687c407081ea8a064af04788&scope.system=all&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:18.471022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14935c6-e855-4e0a-91a9-0f5a6bd238c6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:18.472494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14935c6-e855-4e0a-91a9-0f5a6bd238c6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:18.473247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14935c6-e855-4e0a-91a9-0f5a6bd238c6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:18.476621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 170/335] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:18.482717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:18.483455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:18.483455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:18.512205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:18.513511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:18.578935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:18.609029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 166/336] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:18.649012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14935c6-e855-4e0a-91a9-0f5a6bd238c6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:18.684212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:18.774555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14935c6-e855-4e0a-91a9-0f5a6bd238c6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:18.813898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:18.815152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:18.815637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:18.816108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:18.829174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:18.837921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:18.838806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:18.839642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:18.842471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 171/337] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:18.849305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:18.975727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847517ce-a3a2-4893-8e79-0808eefe08cb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.025719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.026813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.027324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.027796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.028748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:19.029265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.031020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e612fc-94a6-4184-9d10-eaedeb3415f0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.043214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 167/338] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:19.049115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.147196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.165212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2210264-3d3f-4ad4-ac93-3271d0ebedc6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.169113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36599b0-906d-4851-ad57-80d8551bc624 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.169610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36599b0-906d-4851-ad57-80d8551bc624 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.170081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36599b0-906d-4851-ad57-80d8551bc624 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.171944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 168/339] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:19.177276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3293fa-e243-4a83-87e2-d6964ff1280c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.177874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3293fa-e243-4a83-87e2-d6964ff1280c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.178347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3293fa-e243-4a83-87e2-d6964ff1280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.204807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8d3293fa-e243-4a83-87e2-d6964ff1280c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:19.206194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8d3293fa-e243-4a83-87e2-d6964ff1280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:19.232335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.233323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.233804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.234275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.311640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.313678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.321620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.376243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 169/340] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:19.377646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539696-4dea-49a8-9a53-f2d5a239ad9d None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.377936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539696-4dea-49a8-9a53-f2d5a239ad9d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.378221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539696-4dea-49a8-9a53-f2d5a239ad9d None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.379719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 170/341] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:19.385280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.385568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.385850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.412478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.423335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:19.424569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:19.431447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 172/342] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:19.435002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.502218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 171/343] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:19.503019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.552629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233c0a5-c6a2-4a22-858e-78eb4599b4af None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.590397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.591345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.591735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.592016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.604895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:19.611216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6af5-2072-4467-a102-54ef3d121619 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:19.613546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:19.615596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 173/344] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:19.617565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.624006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.654604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.655524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.655812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.656095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.657335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.658865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.660817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 172/345] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:19.661492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.676919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.739043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554442f-9f9e-45e4-b66b-f241e3f698c0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.768614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f82350-0cdd-4689-8458-629eaf4de51f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.777279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.778200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.778486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.778762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.790592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:19.799597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:19.801718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 174/346] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:19.803769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.810058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.810058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.810058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.810058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.810731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:19.810731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.810731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.823250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 173/347] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:19.824145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.862567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.919110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1297-b53c-428d-9005-fdc96d83592d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.927742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:19.932956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879976-a8bd-4a7f-84f7-5aed6b080850 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:19.961925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.963082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.963580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.964000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.971193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:19.971544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.971890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:19.972176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:19.972464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:19.973227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:19.973534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:19.973973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.975714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:19.976633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 175/348] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:19.982063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:19.985289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 174/349] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:19.986248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.096408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312e84-5232-410b-8ab7-3ab7369142e9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.099452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.112808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e2b0-5926-4e78-9a1d-4a5635e868dd None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.133135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.133818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.134107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.134387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.135322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=dec3c81dff03421aa77eb1244e6880fb) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:20.135639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.137087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.144047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 175/350] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:20.144878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.154855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.155584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.155872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.156158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.214546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.256269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b7b7-7f45-4f6b-b958-c38767995ddc None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.260536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.267519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7b899-a5d6-44e1-94ea-b495c48cde00 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.293057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.293900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.294289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.294676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.331580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.378266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.379974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02e5ec-b830-4447-8cd9-c3ee716d4ebc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.426828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 176/351] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:20.432445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d262-9bba-4b3b-b314-8df7018d670c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.432733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d262-9bba-4b3b-b314-8df7018d670c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.433013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d262-9bba-4b3b-b314-8df7018d670c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.434418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 177/352] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:20.440265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d262-9bba-4b3b-b314-8df7018d670c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.498228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 176/353] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:20.499712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0393-0b25-47f7-b960-565bed1f6ed8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.500646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0393-0b25-47f7-b960-565bed1f6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.501135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce0393-0b25-47f7-b960-565bed1f6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.521437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-48ce0393-0b25-47f7-b960-565bed1f6ed8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:20.522799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-48ce0393-0b25-47f7-b960-565bed1f6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:20.526657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.562546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d262-9bba-4b3b-b314-8df7018d670c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.588525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.603165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 177/354] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:20.604675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a926-74d0-4953-b6b3-6d543ad48bb9 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.605062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a926-74d0-4953-b6b3-6d543ad48bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.605551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a926-74d0-4953-b6b3-6d543ad48bb9 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.606948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 178/355] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:20.608963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a926-74d0-4953-b6b3-6d543ad48bb9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.609094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.610236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.610671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.611171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.612832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.615478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708de703-62ec-4981-88b2-9e5eb358e37d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.617677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 178/356] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:20.619072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.619518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.619927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.643179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:20.645403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:20.743778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a926-74d0-4953-b6b3-6d543ad48bb9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.747717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 179/357] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:20.753161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.807459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.808868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.809367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.809838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.811538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.814875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.817183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 179/358] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:20.818158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.857522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.902465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab28d1-8dc1-486b-979e-c86d2494814a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:20.908666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:20.941000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:20.941878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:20.942164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:20.942442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:20.943660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:20.945116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:20.952500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 180/359] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:20.953439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:20.966149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f7a45-a3d4-4fca-8a46-f3466dda099c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.015825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755749e-327c-418e-b11e-90667a744137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.017635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755749e-327c-418e-b11e-90667a744137 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.018137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755749e-327c-418e-b11e-90667a744137 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.018674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755749e-327c-418e-b11e-90667a744137 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.033683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755749e-327c-418e-b11e-90667a744137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8755749e-327c-418e-b11e-90667a744137 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:21.045121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:21.046071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:32:21.046910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:21.050733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 180/360] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:21.050733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755749e-327c-418e-b11e-90667a744137 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.079740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184642-0594-4c9a-89b6-c7966a3f531e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.124420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.125838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.126124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.126400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.129322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.137955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:21.146827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:21.147801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:21.148591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 181/361] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:21.149265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.191662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755749e-327c-418e-b11e-90667a744137 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.217601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.240535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.241723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.242888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.243387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.244866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.246757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.248951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 181/362] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.249716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.288870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b8cc4-afb8-481d-9548-c4655ec77c8e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.338985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.339692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.339978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.340259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.341113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=dec3c81dff03421aa77eb1244e6880fb) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:21.341431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.342892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b2a6-e919-4dfd-bac7-0f953b36a004 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.354508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 182/363] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.355866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f74-0673-41e1-bf50-3edf75f391f2 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.356154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f74-0673-41e1-bf50-3edf75f391f2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.356434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6f74-0673-41e1-bf50-3edf75f391f2 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.357717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 183/364] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:21.358435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6f74-0673-41e1-bf50-3edf75f391f2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.390663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8034a9-4e66-40e3-99da-c661ccfa05d4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.434228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.435428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.435917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.436409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.437368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:21.437971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.439699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.445918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.451381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 182/365] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.452553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.509382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6f74-0673-41e1-bf50-3edf75f391f2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.519270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.558364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.559049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.559361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.559643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.560454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:21.560767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.562202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c23c11-b74c-42b5-8f8b-0ee925e2d7c7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.572784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 184/366] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.574070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.574351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.574679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.588771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd88358-4871-4e71-9024-cf34fd89ec56 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.598016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:21.599297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:21.632728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.633602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.633900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.634585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.635806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:21.636233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.638035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.646437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 183/367] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.647779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.678320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 185/368] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:21.679363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.782480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.845035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38303-b7e9-4b7f-8761-3889f7200bb2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.845623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc0096-43a0-4634-b132-2738361e8d7d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:21.862680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:21.883823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.884706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.885094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.885463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.887331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:21.888229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:21.888515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:21.888798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] PATH_INFO: `/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:21.890044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] RBAC: Authorizing `identity:get_user(user_id=f019ebef01ba4fd3ac8082b9cb64a9fd)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.892176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:21.894827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 184/369] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/users/f019ebef01ba4fd3ac8082b9cb64a9fd => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:21.895693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:21.967867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:21.969489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.012551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6591f2-a2bc-4a7d-8850-058c1be89573 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.050143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.050946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.051263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.051544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.059496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.080435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:22.093780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:22.094940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:22.095781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 185/370] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:22.096438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.137208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 186/371] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:22.138082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.190161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.307559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe5f4f-3966-418c-b170-06aa61d7b94d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.346352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29aeb0-26c6-46b6-bbb4-4d77e7c8e483 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.380829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.381503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.381791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.382070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.382917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] RBAC: Adding query filter params (role.id=0a30bdad67a94fd08b5af57ef5fff119, user.id=f019ebef01ba4fd3ac8082b9cb64a9fd, scope.system=all) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:22.383263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.384721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.403635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 186/372] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/role_assignments?user.id=f019ebef01ba4fd3ac8082b9cb64a9fd&scope.system=all&role.id=0a30bdad67a94fd08b5af57ef5fff119 => generated 510 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:22.406516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.407443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.407937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.408411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.409382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:22.409905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.411606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.411725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.421841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 187/373] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:22.429903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.471525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.546659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.551701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47de93-55e7-4765-b656-543f4f26d190 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.592033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.593046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.593334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.593614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.595692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.597316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.599685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 187/374] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:22.605999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.696449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982923f-74a8-4c8b-8949-6f990b36c74b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.733821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcaa33-2fad-42cb-be66-77a0283f6f6c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.737318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.737986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.738272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.738554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.785184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.786066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.786350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.786628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.789716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.791247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.793291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 188/375] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:22.799683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:22.836092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e30342-0d29-4d43-b75b-dac34df63df1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.847749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.854967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:22.930049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f6f92-9de3-4e94-8786-91555ad724f0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:22.951024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 188/376] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:22.952494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb487c3-0898-4a4f-a4a7-06a9d37f868a None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.952789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb487c3-0898-4a4f-a4a7-06a9d37f868a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.953072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb487c3-0898-4a4f-a4a7-06a9d37f868a None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.955037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 189/377] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:22.960990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.961572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.961857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.973975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:22.974657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:22.975222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:22.975508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:22.976351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:22.976667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:22.978112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:22.982964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:22.984291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 189/378] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:22.984542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:22.984987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.084026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 190/379] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:23.112263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:23.115398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf63c88-1fe0-419e-a6f6-7c2b740a033d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.121217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.159379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.160267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.160551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.160826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] PATH_INFO: `/v3/projects/cf14668381bc465f992daab174b77fd4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.162143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] RBAC: Authorizing `identity:get_project(project_id=cf14668381bc465f992daab174b77fd4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:23.166055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:23.166388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 190/380] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:22 2022] GET /identity/v3/projects/cf14668381bc465f992daab174b77fd4 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:23.176443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.206357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:23.296674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387dff8-e66e-42e7-9cb7-1a6a0d7c5148 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.363625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0ac1-457a-42e9-b0f1-430c1b7f76fe None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.365549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.366426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.366714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.366994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.391909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:23.407166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:23.408103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:23.408899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:23.416072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 191/381] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:23.417852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.435788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.436658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.436945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.437224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] PATH_INFO: `/v3/groups/b512f7e39062495eafbe9cb468a528e0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.450225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] RBAC: Authorizing `identity:get_group(group_id=b512f7e39062495eafbe9cb468a528e0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:23.451722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:23.455595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 191/382] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/groups/b512f7e39062495eafbe9cb468a528e0 => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:23.476961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.533449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:23.618058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b4b0-0630-49cc-b854-e92a2ddda9e3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.635359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e98e4-9683-4ec3-96f9-3b6b69bfca50 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.639490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:23.668202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.668881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.669162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.669438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.670192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:23.670497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:23.671929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:23.680797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.681481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.681767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.682045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.682425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 192/383] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:23.682888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] RBAC: Adding query filter params (group.id=b512f7e39062495eafbe9cb468a528e0, role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=cf14668381bc465f992daab174b77fd4) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:23.686760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:23.686760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:23.688277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:23.691832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 192/384] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/role_assignments?group.id=b512f7e39062495eafbe9cb468a528e0&scope.project.id=cf14668381bc465f992daab174b77fd4&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:23.862190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e5e2a-6748-4bef-9920-1a9f16474a65 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:23.897014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:23.897803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:23.898079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:23.898351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:23.899556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:23.901013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:23.902956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 193/385] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:23.908823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:24.027273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:24.037991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89befd-f0b2-4e7d-b652-6be467834c84 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:24.073054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:24.073926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.074247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.074527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.075743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:24.077186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20ae6-712c-4a42-9e0d-41ce57852989 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:24.079930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 193/386] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:23 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:24.085708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:24.130084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:24.202188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816630d-28e0-4463-ad23-9a1230335473 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:24.249214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:24.250720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.251158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.251451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/groups/82f00ff7e5b74b83b3509c669e788444/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.253734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, group_id=82f00ff7e5b74b83b3509c669e788444, role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:24.255209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:24.278284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02627-5b78-4037-98c1-344269014405 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.278565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02627-5b78-4037-98c1-344269014405 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.278841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e02627-5b78-4037-98c1-344269014405 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.280429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 194/387] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:24.286677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.286973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.287532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 194/388] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 05:32:24 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/groups/82f00ff7e5b74b83b3509c669e788444/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:24.287661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.323725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:24.324991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:24.445703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 195/389] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:24.487708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:24.604581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:24.618356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb917-a9a0-450f-be54-dbfa95994af6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:24.660720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:24.661531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.661814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.662091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.674923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-7973a7a7-80c3-49b6-96ea-e6f47354194f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:24.682846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:24.683770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:24.684759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 195/390] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:24.694543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:24.792102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfd624-c94c-4d04-aa27-165c0f683b78 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.792338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfd624-c94c-4d04-aa27-165c0f683b78 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.792745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfd624-c94c-4d04-aa27-165c0f683b78 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.794447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 196/391] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:24.799938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.800293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.800644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.826385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ce09d-f677-417a-a637-9aeab2583884 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:24.835515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:24.836255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:24.837774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:24.868565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:24.870022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:24.870479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:24.870990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:24.872224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:24.872708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:24.874497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:24.890179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 196/392] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:24.891929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.007637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c23-1a3c-4764-8ba0-0e8ad64e2cca None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.022207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 197/393] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:25.048032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.048955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.049403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.049852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.050296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.052051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.053775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.059237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 197/394] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:24 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:25.065201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.107541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.145431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.163426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32737-9028-47f6-9588-f4f850ffc820 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.185768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0909-2df0-42f3-a1f4-3ede42aaed33 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.202930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.204540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.204875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.205226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.216711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:25.225713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:25.226627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:25.227466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:25.230291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.231819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.232296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.232519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 198/395] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:25.232968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.233365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.234702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.237105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.243079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 198/396] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:25.245583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.347553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcade1cc-3e3d-42ed-bf52-8739c0f4aa83 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.381756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.382439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.387219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.387219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.387219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] RBAC: Adding query filter params (name=member) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:25.387219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.387219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.388468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa3d4-8052-420c-8beb-f38928955eea None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.399277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 199/397] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:25.400727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.407563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.415604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.463916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.465163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.465640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.466199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb/groups/82f00ff7e5b74b83b3509c669e788444/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.470885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec3c81dff03421aa77eb1244e6880fb, group_id=82f00ff7e5b74b83b3509c669e788444, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.472814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.493510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 199/398] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 05:32:25 2022] PUT /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb/groups/82f00ff7e5b74b83b3509c669e788444/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:32:25.520255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9588ff-6523-4def-b207-0b9851507300 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.561322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.562210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.562551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.563512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.564867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.566362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27f539-2436-4701-b785-3951269c2620 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.568509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 200/399] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:25.574207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.580311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483550-98d2-4fa0-9d88-313c448ad1ff None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.580591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483550-98d2-4fa0-9d88-313c448ad1ff None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.580918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e483550-98d2-4fa0-9d88-313c448ad1ff None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.582345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 201/400] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:25.587553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.587839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.588606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.606878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:25.608058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:25.699243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 202/401] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:25.725466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6432a-39c3-4f35-a132-36e48dbfdb56 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.749742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.758000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.782311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.783414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.783695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.784110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:25.785586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:25.787467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:25.790024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 200/402] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:25.796426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:25.834972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:25.934207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8220c6-4710-488c-b8ae-e453f507060a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.966223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122f2d-42ad-42fe-924e-0eb429980e1c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:25.996295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:25.997565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:25.998023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:25.998471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.013575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:26.025007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:26.026316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:26.027177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:26.030120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 203/403] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:26.034223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:26.035333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.036703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:26.037789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.041943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/groups/82f00ff7e5b74b83b3509c669e788444/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.048589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, group_id=82f00ff7e5b74b83b3509c669e788444, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:26.050306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:26.076659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 201/404] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 05:32:25 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/groups/82f00ff7e5b74b83b3509c669e788444/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:32:26.147550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:26.204953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb26d3-2eb7-477b-bc18-a001b180b93a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:26.258861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:26.259564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.259847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.260123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.260882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:26.261187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:26.262571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:26.275664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 204/405] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:26.281486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:26.396425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:26.422747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b7a6-af04-4d1d-b64a-e92a9656f79d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:26.458812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:26.460063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.460542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.461007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.462386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:26.464047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:26.466184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 202/406] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:26 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:26.472985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:26.592357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a3d4-6be0-4160-8342-d24469bf5266 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:26.627578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:26.636992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:26.637866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.638147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.638421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.639638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:26.641802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9c48b-bcf1-47fc-a908-765a81e17dff None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:26.643991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 205/407] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:26 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:26.650136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:26.729824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fd7f-d91c-4b0d-bc83-7a983c1e9a51 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.730115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fd7f-d91c-4b0d-bc83-7a983c1e9a51 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.730290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fd7f-d91c-4b0d-bc83-7a983c1e9a51 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.731690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 206/408] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:26.744705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.745288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.745759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.771164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7808d1e-2651-49fb-89c8-973d5fd5165a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:26.779053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:26.780539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:26.821742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:26.822640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:26.822919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:26.823275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/groups/82f00ff7e5b74b83b3509c669e788444/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:26.826289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f7958b2bf1a41a6bc09565794fbafa2, group_id=82f00ff7e5b74b83b3509c669e788444, role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:26.829695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:26.856053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 203/409] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 05:32:26 2022] PUT /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2/groups/82f00ff7e5b74b83b3509c669e788444/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:26.897994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 207/410] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:26.937139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:26.949587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.070909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e362c40-a583-458a-999a-7d1452c8a225 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.121547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.122355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.122636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.122912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.143300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-dcb2827d-3e81-4449-aabb-c261ec44e2a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:27.151433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:27.152393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:27.153636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 204/411] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:27.158862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.167755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098ce0-ffa9-4be5-870c-3a84b1acf3ed None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.168064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098ce0-ffa9-4be5-870c-3a84b1acf3ed None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.168300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098ce0-ffa9-4be5-870c-3a84b1acf3ed None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.170039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 205/412] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:27.180155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.180684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.181103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.209634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:27.211274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:27.279848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9542f5-2735-4f82-b2ab-af14c3cb36ae None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.299548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.304670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 206/413] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:27.319364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.330215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.330897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.331216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.331498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.332261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:27.332571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:27.333961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:27.343429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 208/414] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:27.349438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.360376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.495090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e08b62-c9cf-4fca-bac3-d04a29e503eb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.533211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.534268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.534693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.535109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.546085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:27.554923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:27.555873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:27.556670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:27.559290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 209/415] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:27.566219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.605789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86f3df-182a-4dbe-9f58-31fbbaa07e53 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.661560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.681255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.682353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.682774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.684360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] PATH_INFO: `/v3/groups/b512f7e39062495eafbe9cb468a528e0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.686602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] RBAC: Authorizing `identity:get_group(group_id=b512f7e39062495eafbe9cb468a528e0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:27.689562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:27.694700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 207/416] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/groups/b512f7e39062495eafbe9cb468a528e0 => generated 229 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:27.698116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.768112 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95715-33e6-4041-8e43-4b9ecdf3ddc6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.810730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.811690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.812123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.813110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:27.814122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:27.814597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:27.816331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:27.830483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 210/417] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:27.835471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.837147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:27.909174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6e3f-07f4-4383-a365-ecd22ea47e40 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.973107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426cab-a364-4df8-987d-57e09a6087a3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:27.983896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:27.996433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:27.997326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:27.997610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:27.997893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] PATH_INFO: `/v3/projects/cf14668381bc465f992daab174b77fd4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.003870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] RBAC: Authorizing `identity:get_project(project_id=cf14668381bc465f992daab174b77fd4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.005339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.007451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 208/418] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/projects/cf14668381bc465f992daab174b77fd4 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:28.015816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.016918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.017354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.017884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.021008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.140052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c102-4504-4e91-bc39-f1aa205f09c6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.170033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.172724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.183373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.184340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.184628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.184962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] PATH_INFO: `/v3/projects/cf14668381bc465f992daab174b77fd4/groups/b512f7e39062495eafbe9cb468a528e0/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.187870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf14668381bc465f992daab174b77fd4, group_id=b512f7e39062495eafbe9cb468a528e0, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.190144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084ee81-758b-44ea-a65d-27eca6162fa8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.193371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:28.216197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 209/419] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 05:32:28 2022] PUT /identity/v3/projects/cf14668381bc465f992daab174b77fd4/groups/b512f7e39062495eafbe9cb468a528e0/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:28.222703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02477-a947-4a26-aa93-f685cb70d0a7 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.222703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02477-a947-4a26-aa93-f685cb70d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.222703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a02477-a947-4a26-aa93-f685cb70d0a7 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.231533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 210/420] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:28.232744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.233048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.233317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.266838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:28.268097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:28.347746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 211/421] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:28.351095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.368960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:28.415905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 211/422] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:28.452840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.511868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d43982-aff3-42b1-9053-9ad92ba1a5bb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.557065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.558024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.558371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.558904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.560527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.562488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.565240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 212/423] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:28.571176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb904c70-7a83-4815-9c03-d1afe5b2c5b5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.572071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.597872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:28.612790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.613918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.614418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.614888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.627158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:28.635466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:28.636346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:28.637135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:28.639500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 212/424] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:28.649669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.684417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:28.765286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835e749-a3b8-4077-8eb2-0ea2b933006d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.778061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a348c-e1ad-45e7-8c60-b735dd331265 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.804898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.805785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.806065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.806310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.807525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.809183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d7cef-f567-45c5-b065-f28df8ed10eb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.811127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 213/425] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:28.812623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15531-337e-4720-850f-61fdb26e4fe8 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.812857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15531-337e-4720-850f-61fdb26e4fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.813134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15531-337e-4720-850f-61fdb26e4fe8 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.818423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 214/426] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:28.818826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.819238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f15531-337e-4720-850f-61fdb26e4fe8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.819975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.820450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.820920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.821973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:28.822523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.824365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891bd85-8d67-4270-87c2-2051876ab2d0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:28.834553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 213/427] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:28.836300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.837215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.837812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.857125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:28.858690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:28.908253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:28.929445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f15531-337e-4720-850f-61fdb26e4fe8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:28.936311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 214/428] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:28.938054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:28.991314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:28.992100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:28.992342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:28.992611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:28.993472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=dec3c81dff03421aa77eb1244e6880fb) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:28.993972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:28.995323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.002470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 215/429] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.003243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.015263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.057476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426ace-211a-474c-bbce-48d0c594487b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.096574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.097703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.098236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.098728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.115445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca85a4-3363-4f3f-aa3a-9b10b9c64f98 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.153429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.154541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.159661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.159661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.159661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] PATH_INFO: `/v3/roles/member` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.169709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:29.179183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:29.180526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:29.181328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 216/430] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:29.185196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.207745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.209688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.257445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.295742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8057-ca11-4b8e-ab06-31186639d4db None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.350402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.351356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.351776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.352203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.353096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] RBAC: Adding query filter params (name=member) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:29.353554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.355272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.372336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 217/431] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.373591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.384543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 215/432] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:29.390073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.475815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.507347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ae7c0-7018-4362-814e-bee0149840d2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.509751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6ce0c-b382-4979-a630-75ee96b75739 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.544826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.549319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.550205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.550489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.550767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] PATH_INFO: `/v3/projects/dec3c81dff03421aa77eb1244e6880fb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.551830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.552029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] RBAC: Authorizing `identity:get_project(project_id=dec3c81dff03421aa77eb1244e6880fb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.552476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.552756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.553029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.553438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721701d-ee29-4cdf-ae17-73020ee43e47 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.555463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 216/433] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/projects/dec3c81dff03421aa77eb1244e6880fb => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.556643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57257-7ab5-4d23-987c-013d43be936a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.556935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57257-7ab5-4d23-987c-013d43be936a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.557213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57257-7ab5-4d23-987c-013d43be936a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.558469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 217/434] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:29.563195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf57257-7ab5-4d23-987c-013d43be936a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.633497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.635371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.667960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf57257-7ab5-4d23-987c-013d43be936a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.707725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.708842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.709301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.709737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.711231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.713302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa644-de00-4fc5-9a1e-747faffdeb9f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.715098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 218/435] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.716526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.716973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.717408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.740526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:29.741734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:29.751002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.756227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 218/436] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:29.756227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.787178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:29.821123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 219/437] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:29.821789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.872305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea0bf-8a15-448d-8261-442973bd6b5b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.908601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.909179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.909454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.909727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.910545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=dec3c81dff03421aa77eb1244e6880fb) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:29.910850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.912323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.927172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 219/438] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=dec3c81dff03421aa77eb1244e6880fb&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.927172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:29.939486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871bae3-f3bb-4504-8fc9-70af6dd264a0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:29.985543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:29.986644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:29.986928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:29.987243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:29.988520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:29.990052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:29.991850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 220/439] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:29.997649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.016276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.059295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.071413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a94615-0a14-4e0d-b0d0-96719d779b15 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.121812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.122652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.122966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.123206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.131401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56230-b3fd-4432-b315-fd65d8a3e1bd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.134748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:30.143574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:30.144497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:30.145454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 220/440] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:30.150487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.178835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.179970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.180254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.180535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.181768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:30.183243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:30.185054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 221/441] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:29 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:30.191937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.277325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1d33-a62a-465d-a3f2-b8b8ab608483 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.311228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.319793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.320795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.321281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.321755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.322743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:30.323345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:30.324930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:30.333928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae9e63-b5fa-47f8-8c1d-b200c4eadbfa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.335285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 221/442] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:30.341170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.372553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.389935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.391593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.391890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.392173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.393018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=0c3b8416418f4545a6c4598e12e222eb, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:30.393333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:30.394778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f003ee-242f-4547-8e9a-9e0c306cd407 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:30.401039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 222/443] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=0c3b8416418f4545a6c4598e12e222eb => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:30.478348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f53f93-5b4b-41f9-a5bd-ead6bae0b2a1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.520391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.521130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.521477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.521760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.600478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:30.601939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:30.620287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.681918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6829-8999-4f64-a2e6-c516282a0c72 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.682235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6829-8999-4f64-a2e6-c516282a0c72 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.682471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a6829-8999-4f64-a2e6-c516282a0c72 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.683919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 223/444] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:30.690768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.691058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.691471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.710211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:30.711443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:30.721405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 222/445] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:30.728596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.795488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 224/446] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:30.820789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.840673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de053bae-c781-4d04-82a6-cebabf4f2c54 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.857840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.877734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.878684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.879039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.879418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] PATH_INFO: `/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.880676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f7958b2bf1a41a6bc09565794fbafa2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:30.882139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:30.883867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 223/447] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/projects/5f7958b2bf1a41a6bc09565794fbafa2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:30.889193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.889992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:30.923382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4846d-32f7-40fc-8369-a2e42c7d8359 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:30.957394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:30.958193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:30.958479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:30.958759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:30.969374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:30.977276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:30.978165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:30.979026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 225/448] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:30.984269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:30.989292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12275d-75d7-40ec-a013-3d9a75b6f3f7 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.024354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.025319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.025606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.025885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] PATH_INFO: `/v3/groups/82f00ff7e5b74b83b3509c669e788444` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.027073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] RBAC: Authorizing `identity:get_group(group_id=82f00ff7e5b74b83b3509c669e788444)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.028560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.030197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 224/449] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/groups/82f00ff7e5b74b83b3509c669e788444 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:31.036359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:31.084673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384ae46-d721-4cfc-9bec-edd5b5d3bf59 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.087432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:31.114612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:31.120027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.120693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.120975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.121257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.121995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:31.122302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.123715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.131620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:31.137053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:31.140044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcea72-cfd2-461d-a0c1-6625d8cc5f02 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.176079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.176733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.177017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.177294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.178125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] RBAC: Adding query filter params (group.id=82f00ff7e5b74b83b3509c669e788444, role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:31.178441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.179914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.185707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 225/451] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:31 2022] GET /identity/v3/role_assignments?group.id=82f00ff7e5b74b83b3509c669e788444&scope.project.id=5f7958b2bf1a41a6bc09565794fbafa2&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:31.240197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72592-32fc-4c66-8756-dcd98d5cdd4e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.275670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.276330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.276613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.276890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.341281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:31.351265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.352721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.451169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 227/452] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:32:31.457258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:31.562998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887b27d-9f61-4e76-8638-eb05881dd72f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.578343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:31.596472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.597330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.597610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.597889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] PATH_INFO: `/v3/projects/cf14668381bc465f992daab174b77fd4` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.599106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=cf14668381bc465f992daab174b77fd4)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.600793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.602485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:32:31 2022] GET /identity/v3/projects/cf14668381bc465f992daab174b77fd4 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:31.608125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:31.698710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:31.705734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37468265-0688-4630-bbb3-d222717d30a6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.739388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.740235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.740517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.740794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] PATH_INFO: `/v3/groups/b512f7e39062495eafbe9cb468a528e0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.741949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] RBAC: Authorizing `identity:get_group(group_id=b512f7e39062495eafbe9cb468a528e0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.743400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c7ad-d522-482a-9926-42bb9b7349e0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.745009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 05:32:31 2022] GET /identity/v3/groups/b512f7e39062495eafbe9cb468a528e0 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:31.750977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:31.848213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7703bf-55d1-46ca-80ab-729ec94dc6a8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:31.880712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:31.881344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:31.881627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:31.881902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:31.882728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] RBAC: Adding query filter params (group.id=b512f7e39062495eafbe9cb468a528e0, role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=cf14668381bc465f992daab174b77fd4) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:31.883041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:31.884519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d056e-a345-44e6-a80a-e91da7f28265 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:31.890272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 05:32:31 2022] GET /identity/v3/role_assignments?group.id=b512f7e39062495eafbe9cb468a528e0&scope.project.id=cf14668381bc465f992daab174b77fd4&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:34.486403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d051-227a-4007-b6f1-5d2afb944a23 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.486936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d051-227a-4007-b6f1-5d2afb944a23 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.486936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d051-227a-4007-b6f1-5d2afb944a23 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.488616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:34.493450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.494223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.494692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.514056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:34.516083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:34.576566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:34.605960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:34.650266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff061-12ae-434a-8690-a21c2e908f65 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.650564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff061-12ae-434a-8690-a21c2e908f65 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.650824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff061-12ae-434a-8690-a21c2e908f65 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.652652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 230/458] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:34.653563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:34.658298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4af7-abff-489f-b460-b5fe2a1c0723 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.658584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4af7-abff-489f-b460-b5fe2a1c0723 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.658864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4af7-abff-489f-b460-b5fe2a1c0723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.677879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1f0b4af7-abff-489f-b460-b5fe2a1c0723 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:34.679565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1f0b4af7-abff-489f-b460-b5fe2a1c0723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:34.782660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce280-b209-485c-a3cb-e07ca8a38949 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:34.788193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 231/459] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:34.789549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8abdd-94f3-4555-92e9-b50f02e7922c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.789840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8abdd-94f3-4555-92e9-b50f02e7922c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.790119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8abdd-94f3-4555-92e9-b50f02e7922c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.791989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 232/460] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:34.797791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.798143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.798434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.818305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:34.819849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:34.841743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:34.842551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:34.842833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:34.843110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:34.858299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:34.860725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:34.880603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:34.881496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:34.882322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:34.882322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:34.882322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:34.882322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:34.884601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 229/461] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:34.885681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:34.909161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 233/462] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:34.910036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:34.939161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:34.955508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.028291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e1778-00dc-4e3a-bc41-81f7adc04b77 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.052148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850581da-237e-4416-8afc-f486ed7a6639 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.064690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.065626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.065910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.066188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.076395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.077869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.087476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.088141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.088422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.088696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.089412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:35.089713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.091087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f2e3-575f-4217-9fa0-eb78c2b52c8d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:35.095870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:35.096696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:35.097634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:35.097634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:35.097634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.097634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:35.097634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 230/463] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:35.098237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.106356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 234/464] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:35.108153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a062d-c259-48b9-8f62-5e7d1d80d155 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.108710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a062d-c259-48b9-8f62-5e7d1d80d155 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.109723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a062d-c259-48b9-8f62-5e7d1d80d155 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.111939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 235/465] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:35.113095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a062d-c259-48b9-8f62-5e7d1d80d155 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.188395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.204763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.208468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113365b-1077-402a-a1eb-d24041943887 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.225226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a062d-c259-48b9-8f62-5e7d1d80d155 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.247437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.248223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.248499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.248766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.260330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.261888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.262070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.262735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.263017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.263334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.264054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:35.264361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.265750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.277487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 236/466] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:35.278285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1796f845-a959-47ae-bada-c22c6edcfd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:35.285404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:35.286275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:35.287760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:35.287760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:35.287760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.287760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:35.287760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 231/467] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:35.288427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.288715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.288997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.308416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:35.309605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:35.386922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 232/468] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:35.387708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.404533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562fbcc-c2cc-4abb-af06-5d27b74c46ca None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.442044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.442988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.443549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.443970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.444950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.446597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.455783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.463355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.480436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 237/469] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:35 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:35.481595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.514700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4a66-079b-4702-a73e-525a39fef2f9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.561314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.562111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.562571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.563188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.564110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.565983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.590468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 233/470] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:35 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:35.591472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.619384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af62df-fcb4-4fde-a9e5-b39faa632837 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.686283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.686936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.687340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.687656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.688776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:35.689086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.690621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.710307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 238/471] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:35.716729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.727549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356705d-b7f6-4c72-bfad-24251dc3b381 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.752638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.777879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.778870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.779176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.779459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.795180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.796501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.802010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-8b1f260d-966b-46c7-9e3b-3bb00a797788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:35.817986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:35.819056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:35.820070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:35.820070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:35.820070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:35.820070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:35.820070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 234/472] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:35.820543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c447d-0ed1-400d-b259-bc2548a11986 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.820827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c447d-0ed1-400d-b259-bc2548a11986 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.821105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c447d-0ed1-400d-b259-bc2548a11986 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.822456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 235/473] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:35.826023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c447d-0ed1-400d-b259-bc2548a11986 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:35.858731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb920ca-9243-4a07-b29f-62d91285851a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.901481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.902267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.902545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.902822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.903806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:35.905018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f85bd-8ead-4beb-a9cc-4bd9cea10f9b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:35.930133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 239/474] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:35 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:35.931645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.932032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:35.932411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:35.951454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:35.952784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:35.957877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c447d-0ed1-400d-b259-bc2548a11986 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:35.998271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:35.999261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:35.999691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:36.000140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:36.001114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:36.001592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:36.003202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:36.018337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 236/475] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:36.024244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:36.034454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 240/476] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:36.058401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:36.061103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:36.128300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:36.151846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8db51-e568-4681-9fce-03315f8011c9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:36.207941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16404e7-7eaa-4a39-90d0-687ca8341a2d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:36.216364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:36.217183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:36.217676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:36.218055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:36.219064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:36.221667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:36.251215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 237/477] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:36 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:32:36.254054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:36.255265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:36.255736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:36.256176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:36.257266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:36.259094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:36.267003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.sql.core [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:32:36.267003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 05:32:36.267003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [parameters: {'id': '12b5973d5e574b6cbbdea6aee7b52509', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 05:32:36.267003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86778) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result.read() Jul 25 05:32:36.284578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:32:36.285509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application yield resource Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise self.value Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application session.commit() Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:32:36.286396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:32:36.287276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:32:36.288177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result.read() Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:32:36.288978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [parameters: {'id': '12b5973d5e574b6cbbdea6aee7b52509', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:36.289772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 05:32:36.290558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:36.293070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 241/478] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 05:32:36 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:36.296375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:36.406294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:36.421447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63233d-9cf8-4238-901b-3f49632cd06d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:36.460215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:36.460992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:36.461252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:36.461525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:36.473071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4e391b06-d203-4796-a61f-0473c704fb6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:36.481563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:36.482470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:36.483391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 238/479] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:36.489403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:36.600650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5545-d9a5-4e5a-b29a-37ce2570014c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:36.610570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:36.638058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:36.638786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:36.639010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:36.639326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:36.640077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:36.640997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:36.642383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062f5d-9d35-445b-8b98-45e54b324267 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:36.651736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 242/480] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:38.103663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779600-3328-460a-95b5-c1901f473cd5 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.104689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779600-3328-460a-95b5-c1901f473cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.105177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779600-3328-460a-95b5-c1901f473cd5 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.106985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 239/481] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:38.113268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ce9b-2b8d-4ea2-99c1-062ad36eea05 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.114126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ce9b-2b8d-4ea2-99c1-062ad36eea05 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.114604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5ce9b-2b8d-4ea2-99c1-062ad36eea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.136687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-87c5ce9b-2b8d-4ea2-99c1-062ad36eea05 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:38.138199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-87c5ce9b-2b8d-4ea2-99c1-062ad36eea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:38.234989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 243/482] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:38.277229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95779600-3328-460a-95b5-c1901f473cd5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:38.294852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31384-53ae-47ee-9852-ea03f2d8a5c8 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.295478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31384-53ae-47ee-9852-ea03f2d8a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.295959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31384-53ae-47ee-9852-ea03f2d8a5c8 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.298328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 244/483] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:38.302854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.303155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.303447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.330164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:38.333170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:38.418841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 245/484] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:38.454650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:38.485313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95779600-3328-460a-95b5-c1901f473cd5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:38.507521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:38.549619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:38.552282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.552761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.553429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.573378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:38.582599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:38.583544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:38.584325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:38.587026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 240/485] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:38.592299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:38.604550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:38.638558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0f45d-f845-42ed-b406-2b9117461d0a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:38.674434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:38.675172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.675476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.675757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.686869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-be2bc695-0d2d-4673-b9a8-41f29c93ef39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:38.695702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:38.696609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:38.698026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 246/486] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:38.698679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681967-25df-4f5c-8735-d3b8109be9d9 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.698679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681967-25df-4f5c-8735-d3b8109be9d9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.698803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1681967-25df-4f5c-8735-d3b8109be9d9 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.700356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 247/487] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:38.708602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.708891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.709170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.715381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e67fa-6a8a-4e3e-8991-2dd66d46212d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:38.730204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:38.731703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:38.763019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:38.763967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.764266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.764530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.765724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:38.766031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:38.767750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:38.779282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 241/488] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:38.780447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:38.812496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 248/489] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:38.813762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:38.856532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:38.885573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:38.927959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84213d-d6f0-48c6-846d-cb76648b9866 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:38.962599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f5dc3-3d78-4568-9dc9-069922f1fe9a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:38.974621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:38.975716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:38.976138 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:38.976858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:38.977953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:38.978331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:38.980101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:38.995284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 242/490] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:38.996416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.006362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.007503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.007953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.008414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.022599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.024695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:39.046463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.047835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.048672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:39.048672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:39.048672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.048672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:39.048672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 249/491] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.048940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.120401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828334-5bf5-431b-9fc8-0eadf1ba4b31 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.122401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.154058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.157081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc36ea-b4db-4c8e-9874-c3c0502a4dac None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.160156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.160964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.161247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.161520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.172241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-fbd3e35a-5185-489b-8027-682310e19a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:39.180132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.181006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:39.181796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 243/492] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.182969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e4b-fc6a-467c-bbc3-53f3475fabc0 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.182969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e4b-fc6a-467c-bbc3-53f3475fabc0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.183104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723e4b-fc6a-467c-bbc3-53f3475fabc0 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.184486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 244/493] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:39.185000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723e4b-fc6a-467c-bbc3-53f3475fabc0 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.203701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.204918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.205508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.205985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.218904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.220775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c917aa42-64c6-4d61-ae3b-8cf7a66f6ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:39.241363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.242354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.243743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:39.243743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:39.243743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.243743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:39.243743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 250/494] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.244281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.244587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.244862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.262648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:39.263845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:39.299974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723e4b-fc6a-467c-bbc3-53f3475fabc0 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.334453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.335488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.335777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.336054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.336780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:39.337087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.338148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 251/495] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:39.338464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.338995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.352857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 245/496] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:39.357866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.397080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.411549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.440533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2c0c-d731-4978-8492-70b30b5b184a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.458915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b952541-5265-40b3-9c6f-f7000ef5478a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.474695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.475657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.475934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.476211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.476944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:39.477246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.478618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0e703-1859-4fca-acc6-e8b3f671560f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 252/497] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390bf4c-e69d-4e7b-a21f-391cae825d17 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390bf4c-e69d-4e7b-a21f-391cae825d17 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390bf4c-e69d-4e7b-a21f-391cae825d17 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 253/498] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:39.491519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390bf4c-e69d-4e7b-a21f-391cae825d17 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.495115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.495803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.496089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.496362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.497088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:39.497395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.498767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.510809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 246/499] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:39.511647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.598031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390bf4c-e69d-4e7b-a21f-391cae825d17 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.609975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bf622-f8b9-450a-8265-07d46c98be12 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.615045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.622744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.634061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.634859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.635143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.635439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.642820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.644342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.645814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.646614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.646898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.647197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.657213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-bd1bf902-65e9-48b4-bd5e-1075a7350e52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:39.660156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.661418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:39.662563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 254/500] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.663156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.663156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.663480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:39.665085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.667063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 247/501] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.668237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.683449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:39.684655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:39.750684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 255/502] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:39.751551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.769519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20734e-e73f-452a-be68-792073474f23 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.804122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.804910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.805193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.805469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.817085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.818545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:39.835626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 248/503] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.837649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.854929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67162c-30af-4504-80c0-4b9c2c333b09 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.862945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.863373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:39.890185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.891677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.891959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.892231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.899113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.900581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:39.914807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:39.915896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 256/504] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:39.916798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:39.942861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7623e5-8eff-42e7-b077-0d2c977df117 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:39.976888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:39.977554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:39.977841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:39.978114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:39.978946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:39.979292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:39.980727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.014050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed72b1-c2c4-4b48-9994-de03369b6d20 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.017466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 249/505] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.018287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.048771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.049559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.049844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.050121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.050865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:40.051207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.052591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.060372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 257/506] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.061151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.088694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.098633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.118334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8825d2-36b5-4f22-80c4-bbd604cf0c88 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.158152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.158942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.159257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.159541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.161969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96439-ab47-4358-9e07-5b4a42acda59 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.169397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.170853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:40.188569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:40.189460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:40.190299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:40.190299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:40.190299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:40.190299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:40.190299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 250/507] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:40.190564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.198626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.199328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.199614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.199892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.200619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:40.200929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.202302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.215475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 258/508] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.216275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.289843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4738f3-02d5-4551-afc9-07a552fe96d0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.304913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.319851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4d5d-45e9-4b76-9c68-934db58e207b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.322188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.322860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.323158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.323446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.324274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:40.324584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.326021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.327643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.350737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 251/509] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.351700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.357874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.357874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.357874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.357874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.425276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.426735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.449287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6b7ba-5d88-4beb-aa60-58ed66a946b6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.483893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.484719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.485004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.485285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.495189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.496653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.511661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:40.514097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:40.514948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:40.516344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:40.516344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:40.516344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:40.516344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:40.516344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 252/510] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:40.517014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.535022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 259/511] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:40.535022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.562519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.616249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fbf8a-0041-464d-a957-d1696d6b76b2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.631524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2763558-cfe2-4229-8675-19497fd3700c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.649889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.650550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.650833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.651115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.651865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:40.652175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.653613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.664615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.664879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 253/512] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.665414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.665672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.665784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.666026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.675519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.676962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:40.691991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:40.692916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:40.693800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 260/513] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:40.694343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.742209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.769100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad589b-aa66-454e-b93e-dc31a47d0128 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.771371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.793929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741234f5-2650-40dc-9223-208577b7de2d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.803483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.804132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.804421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.804699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.827251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.828538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.828851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.829135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.829857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:40.830166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.831585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.842713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 261/514] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:40.843586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.873991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.876219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:40.943139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e991-f6a0-48a7-9272-094c3f3de029 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:40.951719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.973038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 254/515] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:40.973854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:40.977645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:40.978450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:40.978731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:40.978846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:40.979006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:40.990486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:40.992193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:41.009797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:41.010642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:41.011562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:41.011562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:41.011562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:41.011562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:41.011562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 262/516] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:41.011840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.078627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939fe1-17b8-49c2-910e-4db610dd084e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.110010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce529363-23cb-401b-af39-dac94bf4abff None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.112571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.113250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.113536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.113814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.114519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.115992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.139048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 255/517] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:40 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:41.140470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.148506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.149190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.149978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.149978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.150576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:41.150887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.152407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.200613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 263/518] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:41.200613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.213263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.223438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.264736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4f75-46bd-4f01-835c-79953d0e6765 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.302633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.303590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.303823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.304096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.312546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.314114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.327352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d35652-eb83-4fcb-8558-0ca81f0aeab9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:41.331556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:41.332431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:41.333325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 256/519] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:41.333882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.372716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.373520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.373806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.374082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.385670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.387158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:41.405859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:41.406890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:41.407787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:41.407787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:41.407787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:41.407787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:41.407787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 264/520] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:41.408052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.444651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df34ed1-f0c9-4500-991d-f11dabdb513a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.465614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.481053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.481365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.481647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.481924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.482654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:41.482961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.485036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.485388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.502276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 257/521] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:41.502276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.524004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf677f-4a29-494b-b9ad-e083c990b102 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.561100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.561749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.562046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.562340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.608029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324f5cf-a1b5-4ed8-be34-5effe57c4b50 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.636537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.638009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.650219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.651205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.651489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.651759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.652877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:41.653623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.655576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.684070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 258/522] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:41.684070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.712284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.724531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.754301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 265/523] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:41.755765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.790350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e58f-459f-46a1-afa3-80f268324b21 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.826164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.826826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.827106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.827410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.828741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:41.829046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.830477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.846750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 259/524] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:41.846750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.870262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4e34d-789c-4e3c-a49f-366083b28d32 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.907821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.908617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.908895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.909166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:41.916585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:41.918019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:41.933431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:41.934448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 266/525] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:41.935726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:41.946032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.950681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913a18-25f5-40d0-91b5-b3e161b8fd0d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:41.969530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:41.991943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:41.992593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:41.992877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:41.993153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.051888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484072ee-0e83-420a-9869-4330683bbeaa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.063299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.064731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.090003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.090912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.091229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.091514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.103909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.105462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:42.124241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:42.125845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 267/526] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:42.126683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.170267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.175896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 260/527] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:42.176993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.219840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.242114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce106d8a-6472-4230-9224-672a7968d282 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.281809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.282625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.282912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.283221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.285516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679f083-73ba-4ec0-bc85-b0c923832079 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.291169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.292696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:42.308285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:42.309201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:42.310147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 268/528] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:42.310646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.330954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.334403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.334403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.334403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.334403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:42.334403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.335292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.363725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 261/529] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:42.363725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.442982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.445190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a6ac3-d291-4039-8f26-0119aef4282e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.490421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.491946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.492474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.492893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.493801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:42.494250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.494361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cf21-1144-42c7-9672-b968a6e5aa42 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.496115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.511851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 269/530] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:42.513111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.516747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.534514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.535751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.536139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.536539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.549776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.551421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:42.569463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:42.570512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:42.571573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:42.571573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:42.571573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:42.571573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:42.575230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 262/531] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:42.575230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.645176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591aebd-d3a1-4edf-af3e-0de52f332391 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.680696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.681599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.682103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.682537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.683511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:42.683967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.685967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.693983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0b9a8-8500-4ea7-bf38-d03b78e30e9f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.706298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.710451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 270/532] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:42.711493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.740231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.741153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.741436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.741713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.742713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e0ee6a51a843460ba129d08a6c6fb910) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:42.743034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.744937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.760186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 263/533] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/role_assignments?user.id=e0ee6a51a843460ba129d08a6c6fb910&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:42.761202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.855323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:42.905385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f849-961c-469b-aaf3-000f932330d1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.915563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb64da-d51e-4fb5-88da-68b3c002ce83 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:42.947512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.948643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.948938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.949216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.957501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.957633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:42.958511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:42.958975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.959239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:42.959725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:42.960773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:42.961292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:42.962888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:42.976344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:42.977233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:42.978076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 271/534] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:42.983216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:42.983334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 264/535] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:42.984829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.024572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.106255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759d137-7825-455e-9ad8-d55fab238fc0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.119266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36487d-705b-401d-93b0-4864dda752f2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.142513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.151170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.152110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.152571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.153023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.154009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:43.154494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.154880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.155666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.156554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.156907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.157807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=9e060788d6f54f4d9fcbccdb720c3500) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:43.158006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.158234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.159782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.166248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 272/536] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/role_assignments?user.id=9e060788d6f54f4d9fcbccdb720c3500&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:43.166734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.178155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 265/537] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:43.179621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.279761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bafdc-a35b-4830-b75a-9816157527c5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.298363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.305308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491e4b-9c82-4397-a8f0-4978a8caab10 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.317043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.317863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.318144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.318417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.326352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.328451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-5d57f6bc-7a85-4edf-8726-967d887797fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:43.351100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:43.351962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:43.352802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:43.353635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 273/538] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:43.354186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.354734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668152-af20-43bd-88a3-f3ba5d95599a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.355019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668152-af20-43bd-88a3-f3ba5d95599a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.355329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668152-af20-43bd-88a3-f3ba5d95599a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.355885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.356362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.356840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.356952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 274/539] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:43.357933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:43.358255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.360022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36668152-af20-43bd-88a3-f3ba5d95599a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.360214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386528e-30a1-4384-a166-356b195afae6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.366766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 266/540] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:43.368083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.368373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.368656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.390856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:43.392520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:43.421263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.503265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 267/541] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:43.527530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36668152-af20-43bd-88a3-f3ba5d95599a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.527729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.583121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.584383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.585369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.585661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.586939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:43.587122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.589685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.606965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 275/542] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:43.613180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.665962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.694641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39035e6-dc02-4a41-b23e-3880a4d82d24 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.749387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.750522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.750853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.751127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.764504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:43.773554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:43.774459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:43.775266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 268/543] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:43.784106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:43.801134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcaa99-c03e-45bb-ba97-5af1c38cd83a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:43.809191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:43.840239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:43.841256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:43.841737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:43.842207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:43.843825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=24c8c936a12441ba81ace37b997ac0b6) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:43.844336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:43.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:43.852998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 276/544] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/role_assignments?user.id=24c8c936a12441ba81ace37b997ac0b6&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:43.949605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed55d5d-2359-4dae-bcee-6f7293724363 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:44.003636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:44.004738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:44.005234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:44.005720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:44.006485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:44.006794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:44.008217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:44.018854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 269/545] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:44.024096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:44.138852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b53b-90bb-4349-915a-dc96d12981bb None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:44.182752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:44.183595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:44.183879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:44.184153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:44.196399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:44.197874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:44.226116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:44.227017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:44.227898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:44.227898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:44.227898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:44.227898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:44.227898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 277/546] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:44.233009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:44.251509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:44.366501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb57ef-a968-4bd3-a341-9af5b79c007c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:44.404145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:44.404790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:44.405074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:44.405345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:44.406288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:44.406604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:44.408002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:44.424548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 270/547] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:44.428207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:44.471024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:44.556752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af9d2f-bc7a-4828-868b-5a7449b94197 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:44.602139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:44.602985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:44.603296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:44.603576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:44.613822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:44.615337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:44.634644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:44.636913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:44.639624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:44.641158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 278/548] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:44.648220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:44.745942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:44.777597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8e0c-66f5-4e91-9f3a-fe37d3e857d8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:44.813063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:44.813797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:44.814077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:44.814352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:44.815218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:44.815530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:44.816956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fea0c-5928-4e63-ae96-63a8f2fbba1a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:44.839464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 271/549] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:32:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:44.840954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:44.925024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:44.954663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eef4a-c788-47ec-9ca4-d6845ed76fa4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.004476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.005118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.005408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.005684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.095270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.096736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:45.188585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:45.197229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b208-8d55-49dc-90dd-7dc5601000aa None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.197518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b208-8d55-49dc-90dd-7dc5601000aa None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.197798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742b208-8d55-49dc-90dd-7dc5601000aa None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.200504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 272/550] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:45.205231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.205521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.205799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.212324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 279/551] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:45.225837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.228654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:45.229821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:45.305449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 273/552] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:45.323876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.385243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:45.430698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060167ff-b127-4451-89c3-0ecbe613a52c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.445131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bb21-2333-4689-9a7e-b68ca112af50 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.468277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.469482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.469994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.470459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.489964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:45.503745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:45.504766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:45.505601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:45.510831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 274/553] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:45.514975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.516174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.516790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.517292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.521937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.530718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.539556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:45.559294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:45.560188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:45.561505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:45.561505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:45.561505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:45.561505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:45.561505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 280/554] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:45.566668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.619500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:45.634426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65dde7-a404-4b1e-ae09-046dab4d6533 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.652866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:45.673284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.674368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.674844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.675383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.676364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:45.676864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.678431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:45.688522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:45.699185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.714796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbad024-94df-4c86-8657-c282044dd15f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.754266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.755631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.755920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.756206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.756930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:45.757240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.758642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:45.784588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:45.792287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.893825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:45.905273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cd58a-42eb-46d0-9896-84c94124c82b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.910904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce419e4-a492-48ec-a21e-fdfb1be3b20d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:45.956492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.957306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.957591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.957872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.963482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:45.964368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:45.964653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:45.964918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:45.965334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.966785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:45.981959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:45.983393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:45.985382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 282/557] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:45.989618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:45.991232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:45.994799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d157c933-98fd-4032-a6fe-b50eb112dd77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:46.032307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:46.033287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:46.034757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:46.034757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:46.034757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:46.034757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:46.034757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 276/558] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:46.037597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4859-0f5f-4c5f-8748-0f5487de2cf3 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.037597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4859-0f5f-4c5f-8748-0f5487de2cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.037597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b4859-0f5f-4c5f-8748-0f5487de2cf3 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.041376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 277/559] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:46.042262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b4859-0f5f-4c5f-8748-0f5487de2cf3 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.081388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.119992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d2ab4-960e-4d1d-9d64-f3f85199a1ee None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.155338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.156461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.156747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.157104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.157887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:46.158196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.159653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71d077-cc6f-48c5-9597-b499fa275532 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.165126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b4859-0f5f-4c5f-8748-0f5487de2cf3 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.172924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 283/560] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:46.178867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.179164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.179454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.197211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:46.198415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:46.203868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.204742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.205254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.205726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.206672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:46.207236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.208853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a2ded-3e9f-4ca6-9bc9-f83fb2e3a69a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.209778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.226652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 278/561] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:46.228041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897e9f5-caa4-429a-9a3a-c2d75fdeddfc None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.228327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897e9f5-caa4-429a-9a3a-c2d75fdeddfc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.228602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897e9f5-caa4-429a-9a3a-c2d75fdeddfc None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.229858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 279/562] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:46.230537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897e9f5-caa4-429a-9a3a-c2d75fdeddfc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.282355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 284/563] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:46.283702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.338286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.354148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897e9f5-caa4-429a-9a3a-c2d75fdeddfc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.393714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.394456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.394634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.394908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.395761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=fc6a7aae669748718cff961b07facc21) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:46.396072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.397514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe51bb-12f6-411d-9e9a-efab78e4788e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.401991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f86b-ab7b-4191-a8c4-bf70bedd7066 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.403301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 280/564] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/role_assignments?user.id=fc6a7aae669748718cff961b07facc21&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:46.404486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14900-1c4e-4f4c-814b-7837c698b3c3 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.404762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14900-1c4e-4f4c-814b-7837c698b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.405033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd14900-1c4e-4f4c-814b-7837c698b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.424409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2dd14900-1c4e-4f4c-814b-7837c698b3c3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:46.425950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2dd14900-1c4e-4f4c-814b-7837c698b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:46.459081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.460162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.460710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.460990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.472334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.474556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:46.501831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:46.502927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:46.504186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 285/565] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:46.504791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.509549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 281/566] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:46.510880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf474-3896-46e0-a8f1-11c7ab7b80ab None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.511203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf474-3896-46e0-a8f1-11c7ab7b80ab None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.511595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf474-3896-46e0-a8f1-11c7ab7b80ab None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.516417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 282/567] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:46.516417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abf474-3896-46e0-a8f1-11c7ab7b80ab None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.516860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.623795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.629160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd858b-973f-4da5-b166-ae97dd86771c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.640505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abf474-3896-46e0-a8f1-11c7ab7b80ab None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.668770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.669942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.670496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.671264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.678502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.679107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.679420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.679686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.680516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:46.680821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.682243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.685777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e5e69a52-474a-44a0-80f0-2c8f568a1cd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:46.695375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:46.696361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:46.697248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:46.697883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 286/568] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:46.698840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.698947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.699174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.710421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 283/569] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:46.710421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.716699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:46.717897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:46.782545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.795192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 287/570] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:46.796338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.824728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aa04e-1ff6-42e6-8997-1c67ee032409 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.861432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.862234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.862513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.862786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.873132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:46.881366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:46.882300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:46.883183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 284/571] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:46.883897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.889506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:46.922891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1bd74-a348-44f0-876c-f5475473b6e5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:46.960392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:46.960991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:46.961276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:46.961553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:46.962304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:46.962604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:46.964025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:46.977103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 288/572] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:46.977103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:46.996072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f1ff-2d17-4061-be09-d3368dffe1c0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.032715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.033447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.033563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.033777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.034053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.045150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.047216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:47.065339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.066425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.067739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:47.067739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:47.067739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.067739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:47.071142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 285/573] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.072012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.086467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2652-e467-45e3-af25-64429c8fe465 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.122722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.123562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.123852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.124133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.135626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.136035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:47.144872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.145814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:47.146627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:47.150982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 289/574] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.151774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.185474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94dbc1-5361-40ec-8e2c-552814890478 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.221351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.222070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.222355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.222753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.223531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:47.223841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.225489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.235010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 286/575] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:47.235892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.258794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d5f1-1447-4366-bcfd-23726b4263bd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.276564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.295169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.296004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.296764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.297074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.307884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.309348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:47.326752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.327821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.328739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:47.328739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:47.328739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.328739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:47.328739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 290/576] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.329012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.347526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4243a7-ed3e-46cb-9623-b9fc281cfda9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.366950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.386788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.387639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.388092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.388377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.389174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:47.389483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.391098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.409189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 287/577] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:47.409931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.445891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe7664-6558-4d2f-892d-5dfa4fb24955 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.481294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.481885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.482150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.482430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.483194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:47.483505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.485199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.494117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 291/578] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:47.494791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.524724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef96029-b803-4aa5-908f-dfb330cb84d0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.530879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.564873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.565964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.566428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.566904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.578790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.580640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:47.600000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.601149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.602030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:47.602030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:47.602030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.602030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:47.602612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29edc1-4758-4b43-894d-58c9d8130ea9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.603751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 288/579] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.604756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.637584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.646651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.647352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.647638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.647919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.649048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:47.649365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.651104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.667400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 292/580] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:47.668023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.717541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0fe7-6fdf-46f8-b89a-8de79638c2d5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.755423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.756155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.756439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.756713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.762543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.764308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.766080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.773684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e899-c4a1-4f5f-95c3-b594302fde69 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:47.780544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.781683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:47.782550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 289/581] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.783115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.814231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.815030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.815422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.815704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.826005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.827467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:47.845238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:47.846126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:47.846998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:47.846998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:47.846998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:47.846998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:47.846998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:47.847891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.886823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:47.897600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc1d8-3216-4336-a207-857ae7256f07 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:47.931507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:47.932174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:47.932454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:47.932724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:47.933451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:47.933755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:47.935169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:47.948773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 290/583] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:47.949604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:47.964553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554a3fd-a6a3-42d4-9d97-52a0a7cf3266 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.002385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.003272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.003555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.003879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.011970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.013332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:48.028226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:48.029228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 294/584] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.035591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.063519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb306-30c4-4391-8b58-f61022585459 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.102918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.104015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.104493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.104981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.105951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:48.106476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.108119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.121064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 291/585] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:48.122172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.137174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.147709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d52c3-d66d-429d-aff0-28143b303fd9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.184573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.185240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.185518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.185781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.186506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:48.186809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.188267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.201037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 295/586] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:48.201843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.239014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91da6-6339-4c6a-a7cf-7ec556f6f367 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.267732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.274229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.275029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.275338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.275611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.283748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.285224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:48.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:48.301316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:48.302258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 292/587] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:48.302845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.319829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4a822-aa42-4b74-9518-232a074b8339 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.365210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.365998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.366394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.366678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.367555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:48.367868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.369297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.373359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.396941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 296/588] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:48.396941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.409646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad1c3-a0be-4425-a5c9-2499537bb8c2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.443101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.444014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.444290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.444566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e0ee6a51a843460ba129d08a6c6fb910/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.460579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=e0ee6a51a843460ba129d08a6c6fb910, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.462020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.473880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 293/589] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:48 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e0ee6a51a843460ba129d08a6c6fb910/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:48.474665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.501011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad244fba-8aeb-492f-87d1-0f03d7088c13 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.525181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.543605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.544746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.545032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.545314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.556764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.558348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:48.575596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:48.576705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:48.577713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 297/590] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:48.578295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.602505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc347-6dee-44b0-9e28-579037ef7ca9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.628587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.645132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.645818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.646102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.646377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.647306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:48.647621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.649057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c65c1b-7a34-4c02-85d3-53b93f61afbd None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.666801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 294/591] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:48.668302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd002-c5e8-4407-b631-5d54e672ff02 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.668593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd002-c5e8-4407-b631-5d54e672ff02 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.668899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd002-c5e8-4407-b631-5d54e672ff02 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.670284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 295/592] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:48.670897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fd002-c5e8-4407-b631-5d54e672ff02 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.702943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f53e0b-2040-419a-89f0-95e13c44f20c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.740407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.741531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.741956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.742381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.755764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.757697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-791f80a1-507e-4b91-ad9e-ca0ecbcc1414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:48.776439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:48.777358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:48.778238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:48.778238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:48.778238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:48.778238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:48.778238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 298/593] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:48.778966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.779167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.779450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.785328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fd002-c5e8-4407-b631-5d54e672ff02 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.797270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:48.798329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:48.822861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.823565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.823847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.824126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:48.824961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:48.825273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:48.826719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:48.826835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.845431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 296/594] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:48.846269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.877650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 299/595] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:48.878674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:48.894752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:48.961601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd1ae8-7ae8-4b67-b260-aa554900860b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.992025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052485-e6f1-4083-a7d8-1369ba5b66e6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:48.997283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:48.998094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:48.998376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:48.998649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.009641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.011216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:49.029588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.030493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.031592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:49.031592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:49.031592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.031592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:49.031592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 297/596] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.031862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.033242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.033915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.034194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.034466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.035511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:49.035823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.037232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.054214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 300/597] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:49.054214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.080833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.138353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.152375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc6dc5-1ab4-4992-ad9f-4038634cae1d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.164732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c832d-91da-4d59-8198-a745040d47a6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.190433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.191275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.191556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.191989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.199441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.200241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.200525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.200806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.203080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.204585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.213040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:49.222453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.223427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:49.224265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:49.234411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.235217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.237910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:49.237910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:49.237910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.237910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:49.238366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 301/598] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.238460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 298/599] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.238552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.238635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.323323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.341270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512edc0-79bd-4579-8a1f-07283d6d0b43 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.346345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4195d59-e62c-415c-8775-62ebf324fa92 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.381436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.382288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.382408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.382592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.382850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.382949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.383242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.383522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.384244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:49.384552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.385933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.389830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.391507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.394687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.398691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 302/600] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:49.399612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:49.411117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.412507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 299/601] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.413396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.510242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e7db-a6ef-4b26-9d84-83a993e2e491 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.522243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0f317-6540-4b86-b716-89076960e6ef None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.545562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.546757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.547178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.547473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.548190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:49.548503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.549872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.559333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.560002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.560280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.560551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.561289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:49.561590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.562590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 303/602] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:49.563554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.566543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.568287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.581274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 300/603] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:49.581274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.649748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.690857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3ffaa-2efa-4000-982c-cd70210abdeb None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.693222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2911b91-b2d8-4d05-a5bf-a50c4aef65e1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.726788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.727690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.728045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.728389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.729752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.730506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.730793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.731072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.731878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:49.732187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.733620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.736422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.737842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.751806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 301/604] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:49.752456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.753327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.754247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:49.754679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.758250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 304/605] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.759076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.822057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.861552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680993-0b0b-452b-b688-6beae272a191 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.861725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d0a6-9505-454e-88bd-87883696bb27 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:49.884268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:49.896452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.897242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.897521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.897794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.898147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:49.899049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:49.899355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:49.899633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:49.909454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.909892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:49.910931 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.911357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:49.925961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.926851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:49.927773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:49.929993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:49.930810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:49.933028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:49.933028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:49.933028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:49.933028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:49.933636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 302/606] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.933636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:49.935786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 305/607] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:49.936689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.040646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192ff7-c40c-41c4-9a7f-54b59d974a65 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.045216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f026f8-512e-425e-91d7-0f7e7551ef64 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.060439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.079540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.080582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.080960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.081327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.083785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.084401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.084686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.085623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.085741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:50.086042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.087526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.099467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=e82ecd4a337d4c088cf4a45d8c49534a, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.105871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 306/608] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:50.106026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.106134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.127257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 303/609] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:49 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:50.127257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.166843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.235777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae988-b8d2-4b42-9ebd-46ed0a320b36 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.275977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.276797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.277207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.277408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873c3a-3b17-4b83-9103-d7be81f3c087 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.277657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.278562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:50.278966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.280702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.297300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 307/610] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:50.298135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.323095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.324082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.324367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.324643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.325378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:50.325685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.328315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.339417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.344937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 304/611] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:50.350035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.419487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b84d-407e-419a-af64-167341fa6591 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.456938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.457946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.458292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.458576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/9e060788d6f54f4d9fcbccdb720c3500/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.467488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.474218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=9e060788d6f54f4d9fcbccdb720c3500, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.475984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.479817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2c5b-8e97-4070-a605-db87e60a13be None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.504790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 308/612] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:50 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/9e060788d6f54f4d9fcbccdb720c3500/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:50.508259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.546191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.547924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.549725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.550011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/24c8c936a12441ba81ace37b997ac0b6/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.581257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=24c8c936a12441ba81ace37b997ac0b6, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.582778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eda76-c748-4438-8c3e-ef8b2530a159 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.605252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 305/613] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:50 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/24c8c936a12441ba81ace37b997ac0b6/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:32:50.607565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cece57-c05d-4ed5-abac-c6aa0feb4cd6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.608105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cece57-c05d-4ed5-abac-c6aa0feb4cd6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.608592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cece57-c05d-4ed5-abac-c6aa0feb4cd6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.615750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 306/614] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:50.617570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.618331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.618831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.641199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:50.643095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:50.687048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.711086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd3a6e-30cd-4e8a-accd-19a82f7aa979 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.751701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 307/615] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:50.758415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.758415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.758415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.758415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.766070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:50.768345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:50.784779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:50.786091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:50.786994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:50.788316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 309/616] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:50.794099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:50.872990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:50.908130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9fbe8-abb8-47dd-9f43-696a41e6096c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.929303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb53c97-ac3a-49c8-8bbb-9f06f7b1874c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:50.954646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:50.956415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:50.958487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:50.958977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:50.982818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:50.996341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:50.997323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:50.998177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:51.004857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.005902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.006403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.011155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.012344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:51.012956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.013619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 308/617] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:51.015613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.022684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.058775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 310/618] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:32:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:51.063509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.072407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:51.202200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f195021-c03d-49ab-a1e1-f6f0a1ab320f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.225861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7994f-2d52-4fdb-96a1-3bb27642dba0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.254904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.255841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.256345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:51.257192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.257708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.270011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.271509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.283851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.284545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.284830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.285110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.285872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:51.286185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.287599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:51.290617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:51.291670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:51.292959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:51.292959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:51.292959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:51.292959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:51.292959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 311/619] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:51.298443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.309539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 309/620] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:32:51.315114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.426482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:51.520228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f40ef-beb3-486c-a31c-c3fbab3f940f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.523386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8daac5-83be-49ce-a0f3-0bee72d5c7f2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.576486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.577279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.577582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.577865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.596576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.598004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.599825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.600745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.601021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.601292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.602007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:51.602359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.603738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.630406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 312/621] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:51.631910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:51.633980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:51.636623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:51.636623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:51.636623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:51.636623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:51.636623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 310/622] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:51.638792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.643304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.731498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:51.813246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaff11-609b-465e-a72a-04e68de4822d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.827263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063a1d-ade2-45a1-9d92-bc2a44660219 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:51.840188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:51.877757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.878522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.878797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.879067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.888318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.889795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.892855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:51.893537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:51.893812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:51.894085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:51.894823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:51.895145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:51.896581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:51.921358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:51.923872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:51.926073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:51.929850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 311/623] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:51.930013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 313/624] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:51.932364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:51.932594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.081830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac04c34-83f9-4e64-81c9-bbf5b30e8fde None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.129895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c021-fd5c-4366-bd2e-69d6850ab9c1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.141635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.145467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.146271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.146547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.146817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.159694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:52.161145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:52.183494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:52.184488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:32:52.185455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:52.186520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 314/625] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:52.196467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.201959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.203212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.203625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.203904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.204688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:52.204989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:52.206405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:52.231478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 312/626] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:52.237172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.271604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.399762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266606b7-8a67-4827-8443-dd07bff8f2a2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.423774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7215dda-0fa2-405c-9e03-bce8b2f6075e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.475376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.476067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.476347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.476618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.477453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:52.477758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:52.479215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:52.493392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.494291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.494572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.494841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/fc6a7aae669748718cff961b07facc21/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.516405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 315/627] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:52.521160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.522139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=fc6a7aae669748718cff961b07facc21, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:52.526348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33684101-ef85-482c-8598-4c0e38f317e6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:52.549733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 313/628] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:32:52 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/fc6a7aae669748718cff961b07facc21/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:32:52.551188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17419c81-20a1-480f-8e7a-60b5eb1f6770 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.551478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17419c81-20a1-480f-8e7a-60b5eb1f6770 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.551810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17419c81-20a1-480f-8e7a-60b5eb1f6770 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.553407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 314/629] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:52.561015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.561335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.561588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.600754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:52.601945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:52.623160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.651537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.667980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21bc2-4c02-441d-b30c-74f376fe30aa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.730259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.731362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.732598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.733257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.752933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 315/630] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:52.778107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.814265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:52.816464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170459fb-a6a2-4cae-a630-cdef035364fc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:52.886004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d5892-b2c6-48db-93dc-855d83c7296d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:52.913622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.923712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:52.924534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.924820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.925102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.926499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 316/631] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:52.928192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bbdf-b7dd-4d18-8408-23476f7699f4 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.928696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bbdf-b7dd-4d18-8408-23476f7699f4 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.929186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bbdf-b7dd-4d18-8408-23476f7699f4 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.931010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 317/632] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:52.932274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bbdf-b7dd-4d18-8408-23476f7699f4 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:52.937622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-05840235-1b66-4fd2-8506-e4e3c52496f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:52.945492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:52.946468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:52.947742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 316/633] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:32:52.952399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:52.953245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:52.953532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:52.966110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:52.972159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:52.973353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:53.047036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bbdf-b7dd-4d18-8408-23476f7699f4 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.049357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 317/634] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:53.050204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.086432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.087583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.088060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.088520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.099401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.101371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-45756255-1a11-4b50-a807-c928e4b7e915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:53.121300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:53.122276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:53.123206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:53.123206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:53.123206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:53.123206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:53.126039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 318/635] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:53.127544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774710-53b5-42a7-a001-6b00d4a1465c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.127976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774710-53b5-42a7-a001-6b00d4a1465c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.128257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da774710-53b5-42a7-a001-6b00d4a1465c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.129666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 319/636] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:53.130278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774710-53b5-42a7-a001-6b00d4a1465c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.170691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ce53-314b-4a24-9233-3afd4a7609f6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.181894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.208895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.209887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.210363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.210833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.211823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:53.212395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.213855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f2ef8-21d5-43bb-9558-5b69d62e916a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.219970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.229096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 318/637] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:53.230400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.230692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.230977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.241508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da774710-53b5-42a7-a001-6b00d4a1465c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.248689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:53.250447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:53.279988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.280853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.281136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.281413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.292932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:53.301355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:53.302313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:53.303182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 320/638] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:53.303949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.330948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 319/639] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:53.332108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.426846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246daa4-a4ba-4e06-9c9f-2fe36eb245f2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.429940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.450850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1871-8d86-4917-8049-b3798a8ea20c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.463555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.464439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.464748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.464998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.465755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:53.466073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.467493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.480626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.485678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 321/640] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:53.485678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.494489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.495318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.495654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.496051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.507754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.509455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:53.528609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:53.530104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:53.531839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:53.531839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:53.531839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:53.531839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:53.535103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 320/641] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:53.535875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.589063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2904e-f56e-42a0-a473-2e9ded1e021c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.628039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.628861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.629145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.629423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.630167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:53.630481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.631861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.639205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f12db6-e32e-498f-a033-970bc3ce0b3a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.644584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 322/642] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:53.644584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.673175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.680769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.681510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.681790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.682063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.692968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:53.700718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:53.701879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 321/643] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:53.703574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.751677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.761435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c125f5-048e-48ed-b2ba-fec49becb450 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.795283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.796602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.796929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.797206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.804537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.806012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.819293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5db8cb-0f7b-470b-a780-57f1114c4184 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:53.821515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:53.822709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 323/644] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:53.823719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.856952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.857642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.857929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.858206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.859550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:53.859897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.861353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.876580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 322/645] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:53.881711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:53.920808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.937518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1659-da2a-45d5-9182-05c9b5c5ae1f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:53.973264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:53.974058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:53.974349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:53.974626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:53.985220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:53.986146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:53.987651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:53.989016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0de62-cbd8-4da1-828e-2f91a226c0ed None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:54.007371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:54.008291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:54.009189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:54.009189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:54.009189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:54.009189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:54.009189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 324/646] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:54.010019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.033963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.034652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.034911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.035212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.035960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.036271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.037651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.045877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 323/647] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.047078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.125979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2df54-d64c-4859-aeaf-18988c004323 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.152551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cff2da-2062-413f-b5cf-462da16fecd5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.160842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.161585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.161934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.162278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.163147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.163531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.165023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.173146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.179096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 325/648] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.180113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.194620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.195397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.195678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.195953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.205828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.207292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:54.222166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:54.223397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:54.224389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 324/649] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:54.224998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.254887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.302282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae34eaa-4d33-4b6f-b02f-625a2bb0f873 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.338083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.338792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.339038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.339350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.340079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.340389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.341109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67c847-eb64-4c79-8906-44effe506405 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.341768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.355675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 326/650] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.361297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.381618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.382529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.382893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.383318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.395268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.396816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:54.415161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:54.416276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:54.417383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:54.417383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:54.417383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:54.417383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:54.418087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 325/651] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:54.423883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.424937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.473329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cd2c3-7b3a-4ae2-8eca-358677066bb9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.508213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.508562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.509323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.509630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.509861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.510965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e0ee6a51a843460ba129d08a6c6fb910) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.511424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.512975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.519649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 327/652] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/role_assignments?user.id=e0ee6a51a843460ba129d08a6c6fb910&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.520435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.546669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3b132-9768-4c0a-a7ce-96df3438f70a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.587863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.588913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.589378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.589858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.591066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.591604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.593996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.620193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 326/653] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.621508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.663608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece29a7-c816-4b87-a865-4ffde82bcd3a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.696424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.714633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.715810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.717303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.717303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.728160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.729567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.743603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe338f-9a41-41c9-98e3-cfc3df09435d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:54.745618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:54.746546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 328/654] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:54.748042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.791001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.799096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.799800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.800086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.800352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.801075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.801376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.802748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.817248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 327/655] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.818025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:54.872470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899284-beca-4d99-9012-b473aef69d2b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.908943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.909603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.909887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.910166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.926354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8f70-1171-46a0-bebe-1c40aaa8e07f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:54.962745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:54.962981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:54.963474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.963886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.964203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.965169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:54.965528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.967148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a49e0-1c5b-4569-81de-b9f82d68ced6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.983652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:54.985572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:54.987743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 328/656] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:54.989098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ef90-78b0-481b-ba02-8bf059934f64 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:54.989389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ef90-78b0-481b-ba02-8bf059934f64 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:54.989668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ef90-78b0-481b-ba02-8bf059934f64 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:54.995163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 329/657] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:54.995163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ef90-78b0-481b-ba02-8bf059934f64 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.048474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.101190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 329/658] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:55.101190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.109864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ef90-78b0-481b-ba02-8bf059934f64 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.146302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.147110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.147422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.147696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.155070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.157083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-0372431d-344f-4f5c-9dad-d3017c785815 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:55.172243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:55.173219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:55.174225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 330/659] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:55.175654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.175654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.175654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.191549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:55.192722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:55.195786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.217594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355cd99-7502-4ec4-9cc2-63086035bcd5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.254136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.254714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.255002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.255313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.261486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 331/660] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:55.262459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.315434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.351874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.353343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.380255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2927-7c63-4345-b489-a1e54b2e8add None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.417287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.418088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.418371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.418643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.429527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.430983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.441569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:55.449670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:55.450553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 332/661] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:55.451946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.466697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 330/662] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:55.467810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.557023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.566970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ebcb-027f-414c-ba21-f5e451e603a5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.576514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70acfe-b74b-48fa-ab99-9f53e3415c59 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.603457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.604130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.604534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.604809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.605769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:55.606136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.607770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.612813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.613607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.613881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.614151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.624722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:55.631467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 333/663] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:55.631467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:55.632540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:55.633543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:55.634386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 331/664] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:55.635088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.677684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.737167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4747cdb-a39f-4266-bb25-3ea17629afd4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.742648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288289f3-25a1-4841-a7da-a6c9f0b655e5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.773428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.774253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.774533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.774815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.779749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.780973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.781260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.781548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.782371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:55.782683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.784097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.787737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.789177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.801848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 334/665] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:55.801848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:55.807669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:55.808550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:55.809445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:55.809445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:55.809445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:55.809445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:55.809445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 332/666] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:55.809718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:55.816678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.909724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:55.911843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab0337-5354-451f-99a3-06235a7fff0c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.918875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239af612-107a-4b8b-8863-1515da694b04 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:55.949227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.949889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.950178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.950464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.956504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:55.957341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:55.957774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:55.958213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:55.959156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:55.959632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:55.961130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:55.970062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 333/667] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:55.971060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.027412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.028909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.040240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.090134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf64ef3-d16f-4fed-960c-2d1c2b3f5ca9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.129310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.130116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.130395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.130678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.137472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.137972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 335/668] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:56.138919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.139437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:56.155461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:56.156501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:56.157438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 334/669] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:56.158522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.177182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.260483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd76a7-3b56-4e29-9f90-05cc1200ce97 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.266012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922f5c-6ec6-4aa1-97df-9763daf7e5be None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.276250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.304081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.304756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.305040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.305265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.305406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.306031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.306129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.306339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.306456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.306613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.307767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.318704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.324790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 336/670] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:56.324914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.325017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:56.346566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:56.347533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:56.348460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:56.348460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:56.348460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:56.348460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:56.348460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 335/671] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:56.349064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.425888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.438269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3927a-7ae6-485b-9b49-0d5916e99e71 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.465368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44d73-89bd-4854-9cd0-38041d6836b2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.473471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.474274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.474555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.474832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.485814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.487318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.503828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.504497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:56.504717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:56.505664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:56.506562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:56.506562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:56.506562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:56.506562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:56.506804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.506804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.506804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.506992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 337/672] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:56.507590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.511329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.512229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.525981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 336/673] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:56.531460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.533607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.614302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ef9b-d2d5-407c-91a2-c13922a6921b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.641810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c33b6-fa0c-4f30-b783-25f070e471dd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.648545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.649347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.649632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.649910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.657599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.659300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.670769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:56.674532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:56.675520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:56.676426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:56.680625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 338/674] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:56.681223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.682056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.682729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.683040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.683358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.684088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.684400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.685768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.698636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 337/675] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:56.699498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.765163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.783414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f536-5fc3-4037-857c-29ba12594f1a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.797857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab6fe-91c3-42ae-bbbc-e89aa44ab8a4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.817971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.818640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.818918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.819224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.819947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.820260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.821631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.830604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.831281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.831562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.831837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.832657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.832811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 339/676] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:56.833050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.833545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.834373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85c02f-beb3-4a9d-9895-6aa2897691da None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 338/677] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1e0b-b37a-4d2e-8cd8-078e1f9c013e None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1e0b-b37a-4d2e-8cd8-078e1f9c013e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc1e0b-b37a-4d2e-8cd8-078e1f9c013e None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 339/678] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:56.855172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1e0b-b37a-4d2e-8cd8-078e1f9c013e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:56.913394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:56.950898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b17b6-18f0-42f0-a493-b141e6bf05ed None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.968800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc1e0b-b37a-4d2e-8cd8-078e1f9c013e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:56.989078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:56.989758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:56.990038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:56.990313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:56.991106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:56.991459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:56.992893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.007562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 340/679] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.008482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.011496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.013061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.013303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.013590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.013867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.024160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.025606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-5c3eb8dc-a1a3-462d-b6c2-dd62daa097dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:32:57.041294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:57.042481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:32:57.043597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:57.047361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 340/680] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:57.048951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.049238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.049516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.069069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:57.070302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:57.134382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308de2c-7b7e-4454-8507-7d57d64473d6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.146976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 341/681] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:57.147909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.177823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.178864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.179327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.179744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.187449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.189287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.194103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:57.204753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:57.205672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 341/682] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:57.207318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.263492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65b52-c7e8-4887-99b5-30bb9aed5fad None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.268012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.302542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.303342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.303745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.304027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.304853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=9e060788d6f54f4d9fcbccdb720c3500) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:57.305166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.306621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.306884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e8d98-5d74-4a3b-922c-751d1016f125 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.323169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 342/683] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/role_assignments?user.id=9e060788d6f54f4d9fcbccdb720c3500&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.323169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.364856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.365765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.366142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.366547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.367576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:57.367979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.369863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.391269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 342/684] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.392463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.461400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb9de-cb87-49e6-ba33-a63541c7d669 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.472642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.516747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.516993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ea25-eb8e-4c13-9cd5-9e6defe3e014 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.517558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.517881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.518158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.531074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.532695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.539595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:57.554361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:57.555483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 343/685] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:57.556734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.559357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.559730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.560078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.560421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.561357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:57.562700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.564537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.578989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 343/686] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.580869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.678115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032095e-6fd4-4f31-96ef-9ab8b15e5a9d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.712134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a73fb-a80b-4ff2-9230-6c12074ee143 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.715660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.716315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.716604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.716878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.747673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.760647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.761589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.762056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.762538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.763990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:57.764487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.767040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.783770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 344/687] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.787557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.800337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.801807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.844418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:57.915283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 344/688] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:32:57.916525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.927406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421400c-317c-4c7b-8d02-3c6e9c94e5de None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:57.971827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:57.973074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:57.973545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:57.974024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:57.975043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=24c8c936a12441ba81ace37b997ac0b6) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:57.976209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:57.978097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:57.989021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 345/689] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/role_assignments?user.id=24c8c936a12441ba81ace37b997ac0b6&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:57.990063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:57.993775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:58.081815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322cd5-b1f5-4830-ae05-9e95c57c8d94 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.163783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.165138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.165895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.166331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.167465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.170205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.196417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90762e89-182f-40e2-8fda-be4cefc71c4e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.199058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:58.203710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 345/690] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:32:57 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:32:58.241304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.242359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.242866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.243311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.256982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.258715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:58.278892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:58.280059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:58.281747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:58.281747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:58.281747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:58.281747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:58.287275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 346/691] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:58.289964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:58.399266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75428b82-cace-404b-a933-9b7fba301fb9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.414874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:58.442098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.442785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.443068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.443372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.444159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:58.444471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.445840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.464587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 346/692] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:58.465973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:58.573754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5447df-b07b-4067-95a2-ae48fd3032b6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.612093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.612930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.613212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.613488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.621621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.623093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:32:58.638898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:58.641349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:32:58.642263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:32:58.645444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 347/693] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:58.646899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:58.760370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89179-aa6d-4a44-b82c-5ffbb7935f42 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.808429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.809202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.809483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.809787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.810586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:58.810950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.812950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f695be9-5127-4805-b05d-77a4f60c5765 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.831241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 347/694] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:58.833559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:58.852773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:58.941733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1170-963a-4bd5-a26b-4438820f7587 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:58.978106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:58.978773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:58.979055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:58.979359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:58.980192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=fc6a7aae669748718cff961b07facc21) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:58.980503 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:58.981944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f4525-faf7-4704-b302-ad69f42fcfa2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:58.995275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:32:58 2022] GET /identity/v3/role_assignments?user.id=fc6a7aae669748718cff961b07facc21&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:59.080891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8273-b03b-4c7f-a541-5bd5937e89d5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.081475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8273-b03b-4c7f-a541-5bd5937e89d5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.081563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8273-b03b-4c7f-a541-5bd5937e89d5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.083029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 348/696] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:32:59.096941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.097277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.097500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.120425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:59.121662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:59.198431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 349/697] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:32:59.221571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb8273-b03b-4c7f-a541-5bd5937e89d5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:59.262147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:59.348331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb8273-b03b-4c7f-a541-5bd5937e89d5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:59.386457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:59.387301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.387591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.387871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.399173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:32:59.407521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:59.408513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:59.409385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 349/698] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:59.414870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:59.428222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:59.527981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3051e8-e8f3-490c-8fa7-7fa80f21b943 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:59.571057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:59.571791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.572076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.572347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.573101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:32:59.573402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:59.574789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31496ea5-273e-4b18-8a55-a47ca8df26bb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:59.583882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 350/699] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:32:59.592368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:59.632641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0da6-afce-4a6d-a171-5ef4c36cf2f1 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.632843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0da6-afce-4a6d-a171-5ef4c36cf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.633111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0da6-afce-4a6d-a171-5ef4c36cf2f1 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.634721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 351/700] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:32:59.639620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.639929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.640403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.658322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:32:59.659548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:32:59.740601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 352/701] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:32:59.759550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:59.775839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:59.778026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:32:59.779204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3815f-3aaa-4abc-82c4-5463056d428a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:32:59.842784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:32:59.844104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:32:59.844397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:32:59.844680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:32:59.857270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:32:59.859309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:32:59.878117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:32:59.879292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:32:59.880391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:32:59.880391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:32:59.880391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:32:59.880391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:32:59.880391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 350/702] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:32:59.885036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:32:59.991990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd2eca-e411-4bb7-973e-e376842a35c3 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.003426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf02fb-2123-444c-8091-51bb62a679d6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.032438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.033123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.033411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.033713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.034648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:00.034961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.043157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.049987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 351/703] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:00.056174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:00.072706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.073738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.074171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.074596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.075427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.076985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.086210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:00.098354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:00.099412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:00.100624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:00.103661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 353/704] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 05:32:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:00.114193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:00.224715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666df2-2f08-4af0-97ec-b83f0d815168 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.238062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:00.272369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.273170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.273451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.273725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.290900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.292377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.310654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002c53-2fec-4482-a04a-8f861d274667 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:00.326238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:00.327262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:00.328220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 352/705] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:00.333496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:00.379159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.379159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.379159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.379159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.379572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:00.379572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.380557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.385783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 354/706] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:00.395162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:00.513297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3e01-6944-479e-936a-106f530ee995 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.522087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:00.548623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:00.555671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.556678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.556963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.557243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.558218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:00.558530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.559924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.567676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 355/707] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:00.607429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3787-925e-417a-9a4a-488ada3a12f7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.667625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.668338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.668623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.668904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.669789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:00.670108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.672178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee818-142e-4eb2-80ff-dd4bfae15285 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:00.704030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 353/708] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:00.709640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:00.831904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ccd7c-e888-494c-a82f-6282937c486a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:00.860956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d986ba-cb0d-4834-a0d9-c921bbb6e21a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.861463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d986ba-cb0d-4834-a0d9-c921bbb6e21a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.861758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d986ba-cb0d-4834-a0d9-c921bbb6e21a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.863628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 354/709] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:00.868611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.868846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:00.869035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.869199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.869347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:00.869560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:00.869834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:00.891550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:00.892878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:00.942010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:00.951019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:00.952650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.029002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 355/710] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:33:01.063677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.066845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 356/711] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:33:01.076109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.141804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.197658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.197856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff2fb-f45f-4cc1-b1a9-decef9e7710d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.206698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f30f-58b3-420b-846b-a256939a2738 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.239834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.241096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.241688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.242165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] PATH_INFO: `/v3/services/network` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.243049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.244861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.250539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.251490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.251776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.252053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3209f94d-5a1b-4f32-8538-95bd4057d170 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:01.261312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:01.262325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:01.263192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:01.263951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.264530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.267200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 356/712] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:01.268812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4e0d-2762-4f49-b32f-12697406ff0a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.269305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4e0d-2762-4f49-b32f-12697406ff0a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.269800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f4e0d-2762-4f49-b32f-12697406ff0a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.275550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 357/713] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:01.276615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f4e0d-2762-4f49-b32f-12697406ff0a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4eebc123-482f-4ab0-a9c2-157de808a529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:01.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:01.286153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:01.287606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:01.287606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:01.287606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:01.287606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:01.287606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 357/714] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:01.292159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.294289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.294734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.313037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:01.314246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:01.407489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 358/715] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:33:01.408735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.414725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f4e0d-2762-4f49-b32f-12697406ff0a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.447493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.456918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.457914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.458298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.459016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.460089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] RBAC: Adding query filter params (name=network) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:01.460469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.461920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.468371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 358/716] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:01.470043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.513786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.550788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1567b6-8e34-4811-a053-a2ea0a3d5e0d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.590986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe1862-d8b4-4fc4-9f6e-3fab97573741 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.598598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.599624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.600888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.601395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.602803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:01.603338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.605645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.623316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 359/717] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:01.625439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.630492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.631330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.631624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.631904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.643505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:01.651857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:01.652848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:01.653693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:01.658607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 359/718] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:01.659410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.713535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.746453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e099ce1-1c1c-44fe-83d4-145740f73631 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.781585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda97c-0592-43e4-ad12-ea946c4b5e64 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.786444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.787332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.787757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.788213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.789445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] RBAC: Adding query filter params (type=network) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:01.789897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.791819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.794935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:01.803326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 360/719] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:01.804267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.822573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.823155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.823455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.823743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.833193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.834796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-a588f2d1-401a-4716-a4e2-b6d0878541e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:01.851997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:01.852957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:01.853857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 360/720] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:01.855359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c032-e1ad-4f67-9b50-84e6daed23cf None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.855553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c032-e1ad-4f67-9b50-84e6daed23cf None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.855804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2c032-e1ad-4f67-9b50-84e6daed23cf None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.857543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 361/721] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:01.859087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2c032-e1ad-4f67-9b50-84e6daed23cf None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:01.949361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd413-a809-45f7-9e7a-bf5b706f2710 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:01.992204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:01.992899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:01.993181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:01.993456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:01.994225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:01.994534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:01.996048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924783f6-7a45-4d7d-a1f5-aba8aefdc661 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.002245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2c032-e1ad-4f67-9b50-84e6daed23cf None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.004392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.009698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 361/722] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:02.011300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.011863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.013510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.040548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:02.042060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:02.048880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.049827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.050284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.051331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.052318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:02.053233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.055602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.073418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 362/723] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:02.074652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.105899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.123261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 362/724] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:33:02.124869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.203596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941b543-316a-441d-a0e9-2078a318860d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.241125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.242219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.242643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.243123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.248653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2a57-a810-4bb5-be2b-57a22d654a67 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.255568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.257276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:02.275310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:02.276251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:02.277214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:02.277214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:02.277214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:02.277214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:02.279443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 363/725] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:02.280604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.287602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.288280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.288563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.288840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.289727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:02.290049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.291514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.298993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 363/726] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:02.300033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.301405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.364918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.401192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ec6b-de57-425c-b8d3-65ede64864d7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.414423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce8373-977d-4a6d-a51c-68efdd7414c8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.443559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.444763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.445242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.445712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.451679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.452402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.452688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.452960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.453750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:02.454001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.455490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.460032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:02.468933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:02.470139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:02.470986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:02.471669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 364/727] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:02.478863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.479338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 364/728] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:02.496647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.600818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.618975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c9c7b-f800-4aa0-94ed-4c0865fd3f2d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.630761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870201-d521-4b27-b3b4-24f183940ade None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.637426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.658344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.659255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.659537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.660100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.667585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.669036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.672995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.673902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.674377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.674845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.675827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:02.676328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.677890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:02.685156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:02.686096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:02.687385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 365/729] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:02.694540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.694887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 365/730] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:02.709347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.859032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741f665-0ca5-404d-aa0b-b635180425a7 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.887154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aea236-dcfc-47d1-b532-48899bbce502 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:02.894251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.894930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.895262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.895539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.896387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:02.896703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:02.898154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:02.923157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 366/731] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:02.923969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:02.976750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:02.977222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:02.977512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:02.977796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:02.979918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:02.981906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.001632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.003389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:03.037349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:03.038327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:03.039239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:03.039239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:03.039239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:03.039239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:03.048638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 366/732] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:03.055156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.077794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd724a-6c2e-47d0-83d3-6748f5da50da None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.118833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.119501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.119788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.120060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.194755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.196267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e530c-f468-47a1-9a3d-ae9342b3acad None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.208726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cfd45-7e2e-436a-a3cd-e832f25af684 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.238399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.247568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.248239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.248521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.248822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.249661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:03.250057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.251611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e17b8f-dbc5-4aec-a4f6-0a254e10953a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.270262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 367/733] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:03.271900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367ec5-08da-4561-9df7-7aa0dbb82820 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.272194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367ec5-08da-4561-9df7-7aa0dbb82820 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.272474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce367ec5-08da-4561-9df7-7aa0dbb82820 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.274437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 368/734] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:03.275376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce367ec5-08da-4561-9df7-7aa0dbb82820 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.320493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 367/735] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:33:03.321938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.322226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.322559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.331637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.339451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:03.340641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:03.396867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce367ec5-08da-4561-9df7-7aa0dbb82820 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.416531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 368/736] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:33:03.417779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.448410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.449230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.449526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.449809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.457914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.459399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:03.479728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:03.480722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:03.481662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:03.483290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 369/737] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:03.484508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.495810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.539439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9790089-3459-4b24-a7c6-d1e1f63e8d11 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.576281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.578453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.578947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.579448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.591185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.593178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.606605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c2479-caef-4e90-ae81-ab7e6bdbf9f0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:03.615617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:03.616544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:03.617442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:03.617442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:03.617442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:03.617442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:03.617675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 369/738] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:03.618487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.618751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.649901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.650623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.650948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.651192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.651996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.653598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.673200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 370/739] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:03 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:03.674830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.755420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30668fe-50a1-4e88-88f1-cb9f314c05ee None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.781197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:03.812888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.813628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.813917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.814191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.815072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:03.815665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.817122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.817470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a731f0-14b7-4512-852a-70aae2676f14 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:03.840423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 370/740] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:03.846119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.882039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:03.884590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:03.885247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:03.885889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:03.887693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:03.888358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:03.892916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:03.923535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 371/741] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:03.925507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:03.957189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.007909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ec4d-65ab-4d30-abe3-07378df52901 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.049709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa653-28f0-45ac-aaa5-3c7a140c539b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.052188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.053570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.054188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.054825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.091836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.093654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.094006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.094301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.102200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.103779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.105122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:04.122709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:04.123683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:04.125063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 372/742] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:04.129841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.143770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.146382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f4703-3f6c-4bd2-a8a1-e46e30b630c4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.268344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 371/743] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:33:04.269676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71f3-62e9-49c9-b492-3cf12ff084e6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.269969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71f3-62e9-49c9-b492-3cf12ff084e6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.270348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71f3-62e9-49c9-b492-3cf12ff084e6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.272106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 372/744] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:04.277151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce71f3-62e9-49c9-b492-3cf12ff084e6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.373868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.384727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.407805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a83-1d22-4aa0-bb0e-eea467b6b4d6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.416925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce71f3-62e9-49c9-b492-3cf12ff084e6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.445825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.446499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.446780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.447070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.447892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:04.448202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.449640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6b79-2ced-4787-8289-00b844ac4402 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.466960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 373/745] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:04.466960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.466960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.466960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.471513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.472448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.472631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.472875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.484911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.486370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.488866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:04.490756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:04.505599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:04.506619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:04.507567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:04.507567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:04.507567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:04.507567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:04.512776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 373/746] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:04.513723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.591388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 374/747] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:33:04.592326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.641024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec79907-d013-40fd-9028-524d60adcf76 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.674828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.687704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.692725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.693829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.694427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.694936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.696171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=5522122a8e3b4d73a6331d90bf06c623) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:04.697093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.699229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.708251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 374/748] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:04 2022] GET /identity/v3/role_assignments?user.id=5522122a8e3b4d73a6331d90bf06c623&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:04.715263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.733074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63e3e2-5167-495d-bc08-d4713474a3d0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.779496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.780781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.781082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.781362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.782112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:04.782421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.783924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf029b7-e74c-453c-b068-5c5316c1157d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.797683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 375/749] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:04.799225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2901-1653-4fee-a916-b69546875007 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.799520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2901-1653-4fee-a916-b69546875007 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.799809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2901-1653-4fee-a916-b69546875007 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.801515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 376/750] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:04.802584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2901-1653-4fee-a916-b69546875007 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:04.869763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f243fe3-11e5-477f-8617-6a115b2677ad None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.914372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.915043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.915364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.915643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.916517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:04.918286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c1bab-e01c-47c5-9688-294596f10ac3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:04.938086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 375/751] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:04 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:04.939474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.939764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.940107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:04.946608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2901-1653-4fee-a916-b69546875007 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:04.963176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:04.964960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:04.982528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:04.990836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:04.992248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:04.992742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:04.993229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.002842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.005077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.022948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:05.024386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:05.025255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:05.026546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:05.028980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 377/752] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:05.035371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.058647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 376/753] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:05.089695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.172942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd48e-af78-4ec3-bf61-a11af8c42548 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.215951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.216962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.217500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.218128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.219369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:05.219857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.221566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.236012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 378/754] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:05.242079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.260451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88932-1100-4b71-8d6c-35b4a4cc750d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.297431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.298257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.298537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.298809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.300879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:05.315055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:05.327677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:05.328829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:05.329667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 377/755] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:05.339754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.368174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1a00-74f4-4267-9a2b-3c89344b65fe None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.387569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:05.404573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.406788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.407310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.407762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.408821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=fc6a7aae669748718cff961b07facc21) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:05.409309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.410907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.418527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 379/756] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/role_assignments?user.id=fc6a7aae669748718cff961b07facc21&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:05.502472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9610104-56e8-475d-bf60-303a5f671bd3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.547507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.548206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.548487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.548763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.549529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:05.549836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.551274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.561106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 378/757] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:05.566629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.698156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50106b-ffcb-4cf1-837d-c2bbd3efd47f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.714300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:05.743836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.744643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.744917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.745193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.769241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.770617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:05.797972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:05.798949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:05.799864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:05.799864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:05.799864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:05.799864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:05.803564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 380/758] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:05.808768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:05.920524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:05.924374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bfe8f-3920-441b-adc7-7502e0018407 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:05.958985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:05.959686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:05.959966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:05.960237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:05.960952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:05.961254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:05.962611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:05.975510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 379/759] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:05.984247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.130603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98edc1c-dd2c-4612-bbd6-7d4974557baf None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.171787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:06.172589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.172870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.173142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.184851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:06.186275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-856382e6-a24f-4f7f-ae7c-45d30d789e8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:06.208439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:06.210603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:06.212794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 381/760] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:06.219155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.256936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6456-6f82-40f5-9630-3004aa655c52 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.257256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6456-6f82-40f5-9630-3004aa655c52 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.257486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6456-6f82-40f5-9630-3004aa655c52 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.258892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 382/761] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:06.264010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.264239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.264555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.299207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:06.300418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:06.340414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e02cf-a328-4c78-901d-4be77cccb35e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.354249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:06.381397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:06.382425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.382902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.383419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.384459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:06.384962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:06.386606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:06.405783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 380/762] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:06.411246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.430607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:06.478229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 383/763] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:06.512641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.541876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf353b-687f-4cb0-8a42-b78fa32c36aa None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.606603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:06.607428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.607707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.607978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.627181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:06.628645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:06.667400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:06.668324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:06.669232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:06.669232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:06.669232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:06.669232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:06.669232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 381/764] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:06.675774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.698232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27921-40c2-4609-8cfa-343ec0cce8e1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.738164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:06.738985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.739309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.739705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.740371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:06.742532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:06.755605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:06.756579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:06.757416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:06.758206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 384/765] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:06.765851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:06.806627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:06.822209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:06.882708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e0a33-aebb-462c-94d5-4684a13479c3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.944611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb83e-2548-418b-afd0-8d92e29465c8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:06.947476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:06.948162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:06.948447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:06.948731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:06.949464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:06.949775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:06.951239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:06.974141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 382/766] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:06.980505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.018055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.018790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.019080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.021402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.022139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:07.022569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.025026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.035818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 385/767] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:07.042000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.159845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.185222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c749-2967-438f-9b41-5ccb2650078c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.186165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd0867-6d1a-4c47-a2f8-6cc7eb3b8b6d None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.219049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.231153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.231961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.232238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.232509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.239931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.240752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.241392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.241608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.242076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.242365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.243087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:07.243423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.244797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d6f6b-52f6-48ac-bef9-e58dc551a749 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.251642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 386/768] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:07.252955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e157-6eb8-43d3-8cbe-fef76c093fa2 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.253249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e157-6eb8-43d3-8cbe-fef76c093fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.253535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e157-6eb8-43d3-8cbe-fef76c093fa2 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:07.255805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:07.256687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:07.257593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 383/769] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:07.259659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 387/770] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:07.264146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.268046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e157-6eb8-43d3-8cbe-fef76c093fa2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.372976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86aad-1db3-4b1e-a61c-9fad483c1536 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.382358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e157-6eb8-43d3-8cbe-fef76c093fa2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.410491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.411168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.411452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.411723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.412506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:07.412811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.414254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d2b5f-60cd-4c52-a521-32d3d24d136f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.420155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.421146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.421436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.421715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.422564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] RBAC: Adding query filter params (interface=public, service_id=239c2bcfbeab45c3ab9e10020c652556, region_id=RegionOne) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:07.422884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.424446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.431082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 384/771] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:07.433094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.433365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.433644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.436251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 388/772] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/endpoints?service_id=239c2bcfbeab45c3ab9e10020c652556&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:07.437284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.454331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:07.455001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.455961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:07.504659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.538353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 385/773] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:07.539313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.550410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56f6e2-d61b-483c-95dc-d7153e230ce8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.589042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.590003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.590336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.590618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.592729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=e82ecd4a337d4c088cf4a45d8c49534a, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.594308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.611501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 389/774] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:07 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:07.612633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.681749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4b204-6c34-4c9f-9863-6f848d772494 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.719675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.733306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.735313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.735748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.736693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.736849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:07.738221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b733c32-dcbc-4971-a8d1-cffb2da1b964 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:07.745813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 386/775] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:07.747273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2312-ac19-4115-a2f4-86adf1221842 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.747558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2312-ac19-4115-a2f4-86adf1221842 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.747835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2312-ac19-4115-a2f4-86adf1221842 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.750123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 387/776] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:07.751511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb77905-2019-45f2-bf65-4843277d9d55 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:07.755790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.756324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.756814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.794991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:07.801447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:07.829820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:07.831075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:07.831589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:07.832110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:07.850553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:07.859614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:07.860633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:07.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:07.866153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 390/777] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:07.872198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:07.872758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:07.922444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 388/778] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:07.949639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.017450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0603935-feab-4c10-92f4-fefc19eaacee None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.060918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.061671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.062201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.062419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.063822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.064157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.066035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4646c08-e081-4e62-9f2a-aac29bfa8c4b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.068912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7232-91c3-4990-888a-156665d82c29 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.076215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 391/779] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.078683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e07e7-3a3d-4040-b813-990e99b728dc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.078981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e07e7-3a3d-4040-b813-990e99b728dc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.079303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e07e7-3a3d-4040-b813-990e99b728dc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.081212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 392/780] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:08.081633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.086042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e07e7-3a3d-4040-b813-990e99b728dc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.109062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.109968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.110255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.110529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] PATH_INFO: `/v3/services/network` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.111220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.112611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4762f333-8837-4a2c-818b-f01069d0ab5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:08.125587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:08.126595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:08.127444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 389/781] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:07 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:08.128779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.128779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.128930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.146336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:08.147581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:08.178647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.204888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e07e7-3a3d-4040-b813-990e99b728dc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.221681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 390/782] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:08.222513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.261065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.261956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.262238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.262516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.278926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.281063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:08.300838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:08.301754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:08.302636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:08.302636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:08.302636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:08.302636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:08.302636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 393/783] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:08.306177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.329013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6247edd-272d-43db-8fd1-0431c6a769e9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.355642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.369485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.370166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.370451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.370727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.371675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.372298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.373737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.379684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 391/784] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.380685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.412043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.419114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779010-6cf9-4cf9-a633-cfe618d8a0af None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.454618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.455571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.455898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.456178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.467426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:08.476139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:08.477077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 394/785] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:08.478714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.490412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b822002-6d3f-43a0-b6ce-4502ea7f6ed0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.526392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.527064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.527379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.527660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.528392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.528701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.530655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.543335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 392/786] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.544191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.606212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537943ea-2f45-48e9-85d5-edb026cb84f3 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.616262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.647798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.653921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.655638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.656142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.656430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.657400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.657711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.659865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.661150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd678b-9117-4fbf-b1e5-f519fc215dbe None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.671542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 395/787] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.672402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.713891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.714924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.715451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.715928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.717402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.717943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.720013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.736808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 393/788] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.736808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.792391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231dff-835d-4f99-8c3c-43566761ebc2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.829226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.830368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.830829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.831314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.839809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.841555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.846897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537950c-9fb6-4eff-aaad-12b10ab970c0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:08.858173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:08.859792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:08.860758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 396/789] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:08.861468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.896015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:08.900775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:08.902643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:08.903645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:08.903839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:08.904619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] RBAC: Adding query filter params (interface=public, service_id=ba56ff464cd249af870ef66a187c9fa4, region_id=RegionOne) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:08.904935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:08.907084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:08.915289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 394/790] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/endpoints?service_id=ba56ff464cd249af870ef66a187c9fa4&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:08.920070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:08.939787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.001671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cbf21-adc5-4089-b7de-4ea6cd36471e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.034188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d86f0-bf4f-4a15-9839-3766704c8896 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.047841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.048835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.049595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.049886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.064829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.066285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.077532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.078209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.078494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.078772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.079670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:09.080206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.081365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:09.092244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:09.094827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 397/791] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:09.096130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.108364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 395/792] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:09.109268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.186790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.212669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.214843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bbf0-22e6-4916-b0f6-9a3c1ed21870 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.238526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df9ead-17d7-4359-a1f3-89507d5845c2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.253380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.254084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.254455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.254757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.255643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:09.256014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.257489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.270923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 396/793] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:09.272032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.286310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.287537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.288003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.288474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.290078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.291908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.299672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 398/794] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:09.301066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.445785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8311a3f-dce5-4b3d-ad6f-89d512af2833 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.492075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.493153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.493434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.493708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.496949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.511602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.513789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.531027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b5010-c439-4f37-9027-12a166ec1bdc None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:09.537828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:09.538747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:09.539691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:09.539691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:09.539691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:09.539691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:09.540346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 397/795] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:09.547199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.586078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.586889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.587207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.587476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.596842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.599203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:09.614450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:09.616292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:09.617479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 399/796] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:09.622349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.635852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.694352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419ed93-4690-44bf-829b-0c599a5a3b81 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.730541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.731547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.731547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.731837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.732615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:09.732932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.735050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.749502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 398/797] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:09.756304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.782328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c1fa-99c5-44a0-b569-8d94e15bd157 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.808119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:09.853446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.854208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.854557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.854997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.855945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:09.856328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.864745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.869987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db260-27ef-4e99-8185-ebce73271738 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:09.898523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 400/798] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:09.904091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:09.913083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:09.913897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:09.914181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:09.914457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:09.928203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:09.932076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:09.962143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:09.963096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:09.964062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:09.964498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 399/799] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:09.973025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.008070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.049143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830d554-6af1-44e4-bac0-b77e252358a8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.087227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.088142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.088423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.088694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.094274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2a4e-fefb-4ffb-8aa4-4b00f3ca4a87 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.100169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.101867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.102626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-7abc5f56-5ab1-4c87-8461-42fb73a03159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:10.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:10.125237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 401/800] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:10.126682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698651-c0f2-4560-84fe-7f3d732cea90 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.127019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698651-c0f2-4560-84fe-7f3d732cea90 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.127019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e698651-c0f2-4560-84fe-7f3d732cea90 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.128473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 402/801] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:10.129343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4804-5b69-4219-9201-0f53d65f67a8 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.129621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4804-5b69-4219-9201-0f53d65f67a8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.129894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4804-5b69-4219-9201-0f53d65f67a8 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.131089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 403/802] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:10.131785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4804-5b69-4219-9201-0f53d65f67a8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.146492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.147228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.147518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.147799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.148586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:10.148901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.150350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a70a-ec85-4278-95c5-ed545488a6ae None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.163602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 400/803] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:10.164912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0d94-1dd0-46b7-bb33-9532c547f7ae None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.165203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0d94-1dd0-46b7-bb33-9532c547f7ae None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.165477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0d94-1dd0-46b7-bb33-9532c547f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.182155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-147a0d94-1dd0-46b7-bb33-9532c547f7ae None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:10.183369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-147a0d94-1dd0-46b7-bb33-9532c547f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:10.245803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4804-5b69-4219-9201-0f53d65f67a8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.254372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 401/804] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:10.255664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.255958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.256237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.271990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.276992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:10.278930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:10.294412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.295419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.295936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.296357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.297330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:10.297922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.299311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.315872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 404/805] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:10.315872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.359082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 402/806] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:10.364026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.398248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.434055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569eb2-c6ea-4902-880f-89a03a90ab9b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.471290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.472577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.473032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.473478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/5522122a8e3b4d73a6331d90bf06c623/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.474649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2774a-8132-4c2f-afcb-7ed7081929bb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.490756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=5522122a8e3b4d73a6331d90bf06c623, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.492434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.515191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 405/807] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:10 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/5522122a8e3b4d73a6331d90bf06c623/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:10.515191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.520284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.521302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.521683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.521964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.522644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.524172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:10.542675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:10.543752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:33:10.544585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:10.545360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 403/808] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:10.547887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.548016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.644986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415a695-93f8-4172-99a5-a677c22b254a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.674697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.686611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.687394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6e313-9759-4891-bba9-ccc1fbc323e4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.687565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.687852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.688122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.696707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.698174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:10.718041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:10.719110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:10.720143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:10.720575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 406/809] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:10.721885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.744896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.746312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.746592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.746869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.762509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:10.772836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:10.773803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:10.774647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:10.775315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 404/810] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:10.779913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.818361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:10.833531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a19e03-20a4-4267-9a22-74285a2f9ee3 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.868614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca19726-6031-4611-812c-01932396f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.869292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19726-6031-4611-812c-01932396f547 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.869574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19726-6031-4611-812c-01932396f547 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.869849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19726-6031-4611-812c-01932396f547 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.870558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca19726-6031-4611-812c-01932396f547 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:10.870864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca19726-6031-4611-812c-01932396f547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.872545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca19726-6031-4611-812c-01932396f547 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.878270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 407/811] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:10.879097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca19726-6031-4611-812c-01932396f547 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.914299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627cce7-1781-466c-b5e9-2cea777a5b54 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:10.949663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:10.950251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:10.950534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:10.950809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:10.951636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:10.952500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:10.954139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:10.971270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 405/812] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:10.972156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:10.986027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.017332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca19726-6031-4611-812c-01932396f547 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.063553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.063941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.064223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.064494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.065237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:11.065546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.066970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.080590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 408/813] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:11.080590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.094223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.100659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267488-2d64-4071-b65e-6da100b87263 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.141073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.141513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.141794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.142070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.142822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:11.143077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.144489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.154292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 406/814] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 05:33:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:11.154292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.225757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a03f-c2eb-46e6-b0e3-a95cbcdab052 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.234937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.261640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e5c2-33b3-492a-83b6-d018ba37114f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.275782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.277313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.278227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.278822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/fc6a7aae669748718cff961b07facc21/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.282669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=fc6a7aae669748718cff961b07facc21, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.284388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.311158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 409/815] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:11 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/fc6a7aae669748718cff961b07facc21/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:11.311158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.315162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.315162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.315162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.315162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.342180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.345748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:11.383931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:11.384901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:11.385792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:11.385792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:11.385792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:11.385792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:11.386526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 407/816] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:11.396272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.481690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.539121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f09b3-c69c-4f13-b8b5-cb39c3bebc9b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.574926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fed29-cdd3-4041-bd2e-6bf02c9f7cb7 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.583436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.584448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.584927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.585500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.586433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.588128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca989cc0-dba9-4559-a3e6-9551f53d551e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.610450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.617337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.618200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.618559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.618847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.619661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:11.620025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.621229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 410/817] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:11.621482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.633389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2124d-6a00-4ef6-9b87-5f4cf1c4fc2c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.633685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2124d-6a00-4ef6-9b87-5f4cf1c4fc2c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.633970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2124d-6a00-4ef6-9b87-5f4cf1c4fc2c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.635867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 411/818] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:11.636159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 408/819] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:11.641820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.642016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.642455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.642866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.666014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:11.668865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:11.765973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd59f-60e6-4f25-bdb7-cb053dfaeb69 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.813143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:11.813959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:11.814247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:11.814525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:11.820438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 412/820] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:11.823438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:11.824917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:11.840576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:11.841555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:11.843190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 409/821] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:11.848478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.850053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:11.898702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.949230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:11.952614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0a28-d0a3-452f-b2d1-055a6b210fba None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:11.963392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1375175-d3ba-4fd2-b259-7aa3b29b063a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.006196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.006872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.007185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.007464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.008306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:12.008616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.009259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.010045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.010495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.010968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.011466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] PATH_INFO: `/v3/services/network` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.012348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.013983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:12.028023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:12.029030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:33:12.029868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:12.030683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 410/822] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:12.036677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 413/823] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:11 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:12.036806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:12.036885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:12.149866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bad7b-39e5-44d8-9bc5-0aaef3b0282d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.179575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:12.189115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.189803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.190693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.191023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.191936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] RBAC: Adding query filter params (name=network) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:12.192260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.193956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.199408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 414/824] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:12.205287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:12.324320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2169e-6d8a-4727-b3c2-e8885fef3a82 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.338274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:12.344331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311538-daca-402d-b852-babbbd6c0187 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.385742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.386578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.386968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.387374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.408599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.409303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.409593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.409876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.410607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] RBAC: Adding query filter params (type=network) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:12.410921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.412459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.429902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 415/825] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:12.435483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:12.584524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:12.598321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.599985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.705019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 411/826] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:33:12.705368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:12.711745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:12.729732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca18f-4ac5-4223-ba92-7109ac9ad723 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.773662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.774719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.775243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.775730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.776667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.778245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13d8b-6edb-4291-9468-d5f810f7a884 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:12.802946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 416/827] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:33:12.930515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e443a-18be-47e4-a630-9c18d00884c5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:12.931092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539839-95d4-4471-8fd3-ea3f11f5e3dc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.931610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539839-95d4-4471-8fd3-ea3f11f5e3dc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.932430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539839-95d4-4471-8fd3-ea3f11f5e3dc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.935480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 417/828] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:12.943670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.944905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.945400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.966580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:12.968513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:12.982908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:12.984479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:12.984885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:12.985302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:12.996349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:12.997785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:13.017830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:13.019271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:13.020183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:13.020183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:13.020183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:13.020183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:13.023515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 412/829] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:13.025405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.056039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 418/830] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:13.079362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.084706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.125730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.138375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d15fee-872d-4260-86f7-fead5cce7e1e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.177503 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.178422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.178536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.178729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.182009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:13.182276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.183803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.203289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 413/831] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:13.205402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.209242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9584ae-f0d7-4df4-a217-d78b9f8ac6ed None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.250073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.251305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.251821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.252326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.264655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:13.273214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:13.274224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:33:13.275069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:13.277790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 419/832] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:13.284325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.324138 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019839-323b-44aa-b3c8-2c109c68c678 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.333582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.360463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.361270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.361611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.361890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.369206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.370722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:13.386772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:13.387777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:13.388716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 414/833] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:13.393877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.403839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880376-234c-44a5-9a77-1815287a5be5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.406167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.444687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.445702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.446190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.446665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.447777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:13.448293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.449991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.463981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 420/834] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:13.465263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.516963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7440b-60c8-4ff0-bf55-1bfc372c2664 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.560165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.561235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.562041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.562316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.563422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:13.563737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.565346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.580606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 415/835] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:13.586088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.592300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd0c8-8934-43e7-b28b-4eb14c7a24cd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.617738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.646312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.648243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.648740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.649498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.666273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.668051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:13.687987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:13.688949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:13.689847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:13.689847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:13.689847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:13.689847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:13.696897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 421/836] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:13.697973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.698170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b542-088a-4843-b2eb-c67b3933060b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.712253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.735707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.736428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.736717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.736999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.737841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:13.738161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.739632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3222f-5b06-4365-8bcb-8bc7d686109d None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.751296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 416/837] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:13.783530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9ffe-f44e-4af4-accd-795302a55e8d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.783851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9ffe-f44e-4af4-accd-795302a55e8d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.784080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f9ffe-f44e-4af4-accd-795302a55e8d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.786269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 417/838] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:13.791299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.791581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.791860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.812507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:13.814277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:13.823695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5704a8-172b-4266-91a4-b0cc5702032b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:13.865356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:13.866400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:13.866920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:13.867433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:13.868379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:13.869038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:13.870552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:13.885418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 422/839] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:13.891895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.909677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 418/840] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:13.928448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:13.956648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:13.991736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.031726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cb10-1e41-47a7-9768-fa362abee0bd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.055605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f67b3-5c5e-4d3a-b26e-7370c56c8b1a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.078996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.080142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.080850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.081131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.091283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.091584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.092525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.092779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.093023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.093466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.104985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:14.111864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:14.112804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:14.113831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 423/841] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:14.114435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:14.115984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:14.117059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 419/842] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:14.118926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.120693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.209590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.230246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83042c6-5672-4d33-8234-2d80d0678754 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.246454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab74d-8cf9-488a-88c8-4b37437685d2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.267891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.268569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.268909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.269205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.269945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:14.270256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.271720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72971a4-39bf-498d-aca3-d79965995a13 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.277487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.281858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 420/843] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:14.283212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72b1c-75de-46a5-b24e-92345bdf55f3 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.283507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72b1c-75de-46a5-b24e-92345bdf55f3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.283792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72b1c-75de-46a5-b24e-92345bdf55f3 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.285321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 421/844] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:14.287662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.287957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72b1c-75de-46a5-b24e-92345bdf55f3 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.288912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.289400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.289903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.291165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:14.291478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.293816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf844a-d323-4505-a80e-e481bf4884f3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.315090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 424/845] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:14.316274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.316565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.316843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.332956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:14.334168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:14.411961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 425/846] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:14.412824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.419851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72b1c-75de-46a5-b24e-92345bdf55f3 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.459270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.460124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.460638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.460638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.471697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.473130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.475857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:14.491517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:14.492453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:14.493350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:14.493350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:14.493350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:14.493350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:14.493350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 422/847] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:14.494212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.532598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b005b-0f70-4864-a30a-abc87f9db81d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.553070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.573288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.573949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.574235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.574704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.598741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3292-027d-4df5-a87b-7ece174986aa None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.635539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.636344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.636633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.636887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.637533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.639106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.651070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:14.651871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:14.652825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:14.653670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:14.654441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.654518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 423/848] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:14.654518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.721772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.767529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aa436-26c6-4342-b1bc-185cf6654439 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.770381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 426/849] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:33:14.771259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.790467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.808395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.809533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.809533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.809706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.810316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:14.810627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.812068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.829953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 424/850] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:14.829953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.876698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5488-0936-4f8d-a2a5-20a4e0701331 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.911142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.911835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.912122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.912388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.913088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:14.913395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.914761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:14.924570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 427/851] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:14.924570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:14.942032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd00ef-5743-4752-a75e-01f0439d8491 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:14.962877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:14.978764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:14.979547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:14.979825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:14.980097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:14.992563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:14.994057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.011388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:15.013834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:15.014927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 425/852] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:15.016215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.036774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18953093-5fe4-443f-9203-4d915d0d444a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.073436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.074258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.074522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.074798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.082861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.084497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:15.099917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:15.101155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:15.102105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 428/853] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:15.102688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.126476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714bd74-965d-4322-ab3e-ee3fa1b66db5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.161485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.162143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.162422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.162696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.163450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:15.163750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.165101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.179166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 426/854] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:15.179166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.216056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.222778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24a4b9-1eab-410b-8701-3dd8e586979e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.274625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.275614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.276326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.276758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.278259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:15.279029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.281441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.300419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 429/855] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:15.301886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f9a3-c77a-42a6-a386-23937dc9860c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.305894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.308927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.351036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.351917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.352344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.352761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.353794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:15.354426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.356623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.378242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 427/856] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:15.383681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.435168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840bdb-77c0-45e6-8d87-dc35cecbbfa1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.473735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.474920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.475297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.475842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.485734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.487224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.494048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.504844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ff93e-743a-4023-8a07-10ef942302e4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:15.505753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:15.506646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:15.507568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 430/857] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:15.515103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.548232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.548901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.549255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.549598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.595833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.631753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.633492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.648027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf268fa-1c53-430d-ab08-931582ff2ed7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.693185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.694118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.694509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.694878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.695806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:15.696214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.697736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.715482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 431/858] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:15.717159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.749305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.759169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 428/859] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:15.766954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:15.827413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57950ed-2384-4152-85e8-b548a3ab975f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.859406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:15.877033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.878610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.879305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.879732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.881416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=5522122a8e3b4d73a6331d90bf06c623) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:15.881881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.884571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2a9f9-f5cc-42d7-bc8a-2aa728df1028 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.889839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc7721-b1d8-4b2e-88df-8c4be5cb2670 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:15.893928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 432/860] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/role_assignments?user.id=5522122a8e3b4d73a6331d90bf06c623&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:15.942260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1185-c85a-479d-a910-e6a71a38dad6 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.942570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1185-c85a-479d-a910-e6a71a38dad6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.942820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1185-c85a-479d-a910-e6a71a38dad6 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.948192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:15.948359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 433/861] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:15.949051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.949331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.949602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.949997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:15.950289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:15.950574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:15.962959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:15.964143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:15.969567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:15.970972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:15.984876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:15.986006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:15.987095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:15.987095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:15.987095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:15.987095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:15.987095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 429/862] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:15.994662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.047824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:16.054276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 434/863] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:16.076818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.103078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421f5ef-27d9-4739-b0c7-d4098296a295 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.144640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.144872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.145079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.145320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.146042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:16.146349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.149027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.163911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 430/864] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:16.169250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.208514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f45a42-fe08-482f-9dcf-e343c1df0813 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.229478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:16.249526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.250915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.251608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.252464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.253563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.255108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:16.272161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:16.273142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:16.273997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:16.277496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 435/865] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:16.287184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.304863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85606531-a706-4b8d-910d-f47b12821ac5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.319556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:16.368720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.368919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.369067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.369345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.376914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.378486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:16.394343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:16.395541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:16.396640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 431/866] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:16.401966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.404838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50cadb-25ac-4574-a58e-6d7168e65c77 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.442374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.443388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.443876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.444361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.445263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:16.445755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.447345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.453283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 436/867] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:16.458526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.507196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:16.512948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8405b8b-4966-4585-82aa-1c3a6030d64c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.552192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.552856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.553134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.553406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.554247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:16.554558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.556037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.570916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d0db6-4f32-44c2-8c9b-0378ce0a9144 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.574476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 432/868] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:16.575677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:16.606161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:16.613468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.614442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.614961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.615525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.616436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:16.616947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.618521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447fd3f-8367-43bc-adf4-cd54ba820a36 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.624477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 437/869] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:16.689393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7f845-b2c8-41c9-9f21-d00031d56b8e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:16.727799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:16.728471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:16.728748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:16.729023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:16.729864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=fc6a7aae669748718cff961b07facc21) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:16.730176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:16.731683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be08d-3a5f-4b57-948c-60f451bdf61a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:16.739588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 433/870] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:16 2022] GET /identity/v3/role_assignments?user.id=fc6a7aae669748718cff961b07facc21&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:17.352957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a2c1-4b0e-49be-84db-fc875662c020 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:17.353360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a2c1-4b0e-49be-84db-fc875662c020 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:17.353543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a2c1-4b0e-49be-84db-fc875662c020 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:17.355170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 438/871] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:17.361128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526e1f-744d-4b30-b3e1-422d0930d6b8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:17.361532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526e1f-744d-4b30-b3e1-422d0930d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:17.361705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526e1f-744d-4b30-b3e1-422d0930d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:17.378609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0f526e1f-744d-4b30-b3e1-422d0930d6b8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:17.379819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0f526e1f-744d-4b30-b3e1-422d0930d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:17.449699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 434/872] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:17.472864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a2c1-4b0e-49be-84db-fc875662c020 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:17.583365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a2c1-4b0e-49be-84db-fc875662c020 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:17.593103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:17.619716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:17.620315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:17.620599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:17.620876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:17.621614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:17.622977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f4049-a61a-4405-892b-2ba2233d08e9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:17.640644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 439/873] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:17 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:18.167940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9d8b-4d3b-497c-84d0-4933d530c1ab None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.168317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9d8b-4d3b-497c-84d0-4933d530c1ab None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.168493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac9d8b-4d3b-497c-84d0-4933d530c1ab None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.170145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 435/874] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:18.175721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.176023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.176298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.194967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:18.196212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:18.273696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 440/875] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:18.297210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac9d8b-4d3b-497c-84d0-4933d530c1ab None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:18.321407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:18.418088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac9d8b-4d3b-497c-84d0-4933d530c1ab None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:18.454401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:18.455256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.455546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.455817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.466601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:18.474744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:18.475986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:18.477262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 436/876] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:18.484987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:18.581115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:18.588122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038bb97-9086-44c7-82fe-76fe3ba871f3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:18.630282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:18.630970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.631303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.631585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.632339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:18.632648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:18.634040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b7595-fc4f-4e3e-8c20-1709fea58a46 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:18.643321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 441/877] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:18.648827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:18.735857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:18.739704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e16ab-9907-4e9e-b77e-633eb518eac9 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.740000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e16ab-9907-4e9e-b77e-633eb518eac9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.740288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e16ab-9907-4e9e-b77e-633eb518eac9 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.741940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 442/878] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:18.746998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.747320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.747607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.761969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac89ff-7cb2-490d-92a0-bed6ce9392da None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:18.770035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:18.772010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:18.803422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:18.803899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:18.804168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:18.804441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:18.817461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:18.818924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:18.837557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:18.838517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:18.839931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:18.839931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:18.839931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:18.839931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:18.839931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 437/879] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:18.845805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:18.871769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 443/880] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:18.893503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:18.970109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6474b6-bfb7-4b8b-8bd2-adecc20f506b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:18.984308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.000093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adccfd8-cdec-4559-8d1f-86cae13d463f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.004028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.010008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.010677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.011082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.011392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.012119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:19.012431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.014029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98c716-7ecc-4438-9d99-104f975d9a30 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.031202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 438/881] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:19.031202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d5d8-7c2e-4aab-819b-852f308a340a None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.031202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d5d8-7c2e-4aab-819b-852f308a340a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.031202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d5d8-7c2e-4aab-819b-852f308a340a None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.031202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 439/882] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:19.036046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816d5d8-7c2e-4aab-819b-852f308a340a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.040994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.041658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.041938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.042210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.042933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.044319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e874e-14ce-4e0d-83a9-37cb9dadfaea None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.063384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 444/883] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:18 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:33:19.065879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.066384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.066875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.086805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:19.089029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:19.192888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 445/884] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:19.198116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816d5d8-7c2e-4aab-819b-852f308a340a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.220720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.245146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.245474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.245728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.246000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.255329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.256966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:19.273249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:19.274373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:19.275505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:19.277797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:19.286576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.323572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.347503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495645-22e2-42a5-9af3-3d961d1e56e9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.362272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.397575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.398434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.398709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.398982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.400000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.401671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:19.418911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:19.420388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:19.424015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 446/886] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:19.427897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.430587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c83ba-f95b-4aea-a5ab-8afcc77f818b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.471552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.472250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.472524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.472843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.473648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:19.473958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.475808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.504959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 441/887] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:19.506622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.569461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0d7b-f1c6-4328-8204-ef6b32e20974 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.608114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.609011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.609390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.609765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.610625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:19.610957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.612585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.614710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.624841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 447/888] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:19.626152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.649802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f60f72-5b3e-427e-b254-a7f46fd215e4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.663660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.708216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.709057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.709342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.709617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.762864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76e44-b0e1-46d7-9522-27b3c565ff5e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:19.801214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:19.801971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.802411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.802893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.803365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.803745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.804464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:19.804947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:19.806684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d6cc4-98ba-4590-9f99-404120ba86d7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:19.813120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 448/889] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:19.815205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2178b-15a3-4ef1-ba68-563969a15d75 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.815504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2178b-15a3-4ef1-ba68-563969a15d75 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.815790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2178b-15a3-4ef1-ba68-563969a15d75 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.821526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 449/890] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:19.822885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:19.823209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:19.823499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:19.845555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:19.846925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:19.922313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.934757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 442/891] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:33:19.939292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 450/892] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:19.944298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:19.957762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:19.964674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.085033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec544f8-d165-4883-a914-51e9d641eea0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.098919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecd2e-cc06-48e8-9e2c-976f6ebd3e1f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.121937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.123052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.123644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.124690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.135323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.136843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.142719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.143798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.144752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.145241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.146594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.148624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:20.155538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:20.156539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:20.157448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:20.157448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:20.157448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:20.157448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:20.161633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 443/893] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:20.162750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:20.164614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:20.165585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:20.166431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:20.168834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 451/894] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:20.175883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.235682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.267563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.279380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046e330-020f-4986-8ee5-ac2893da1515 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.305977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9aae-64aa-4dce-a361-c32ad71ee597 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.316784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.317933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.318315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.318688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.319855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.320530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.322167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.339381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 444/895] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:20.344519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.356873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.357762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.358299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.358726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.359877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.360335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.361964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.368398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 452/896] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:20.376341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.470361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da0b-655f-4dbe-bc85-580067a0e34a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.501186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.513857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a175f-8102-4a81-9e11-047582a9a9d6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.518217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.519099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.519517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.519881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.528664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.530564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.540989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:20.552768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:20.553696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:20.554592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:20.557768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.558733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 445/897] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:20.559283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.559600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.560093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.560574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.562078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.562824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.564633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.570897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 453/898] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:20.579544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.688503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d7d85-d792-430f-8327-2ee1a2e22eea None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.698308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e7c5-f449-48f1-b2d0-3593785379cc None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.725270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.726478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.726985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.727513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.728604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] RBAC: Adding query filter params (interface=public, service_id=0c871720831a412aa54c4be589511541, region_id=RegionOne) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.729207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.731021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.737697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 454/899] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/endpoints?service_id=0c871720831a412aa54c4be589511541&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:20.742924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.743285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.743631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.743985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.744267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.745176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.745485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.747217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.766371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 446/900] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:20.769562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:20.805789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.828176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:20.869638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b56689-0684-43ab-9473-4df3899aa6aa None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.895632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a242-9a82-4202-b399-fc79253c7062 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:20.917395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.918602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.919087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.919566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.921071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.922887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06654853-19b5-44f0-990c-c7a887794579 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.931073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 455/901] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:33:20.939465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:20.939465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:20.939465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:20.939465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:20.939824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] RBAC: Adding query filter params (role.id=9b1f23ffdb77452281a6ddc993884536, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=5522122a8e3b4d73a6331d90bf06c623) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:20.939824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:20.939824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c218a4-44ca-4748-a312-6e16672fe015 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:20.951331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 447/902] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:20 2022] GET /identity/v3/role_assignments?user.id=5522122a8e3b4d73a6331d90bf06c623&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=9b1f23ffdb77452281a6ddc993884536 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:21.348777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673636d8-9b3f-408f-90b4-e43d6ed4c002 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.349070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673636d8-9b3f-408f-90b4-e43d6ed4c002 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.349356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673636d8-9b3f-408f-90b4-e43d6ed4c002 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.351147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 456/903] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:21.356510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.356802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.357085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.377558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:21.378983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:21.449828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 448/904] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:21.474021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673636d8-9b3f-408f-90b4-e43d6ed4c002 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:21.583273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673636d8-9b3f-408f-90b4-e43d6ed4c002 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:21.597954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:21.620097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:21.620916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.621194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.621471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.622122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:21.624124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:21.636580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:21.637554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:21.638379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 457/905] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 05:33:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:21.646073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:21.682664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:21.756455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688b44-5631-471c-a7b5-4a83fd406670 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:21.790368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:21.791033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.791341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.791617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.792317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:21.792622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:21.793981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:21.799657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 449/906] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:21.808282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:21.910453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002bf4-2b6e-4299-baf5-ecf8852ad42b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:21.944526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:21.945558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.946061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.946550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.947479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:21.948004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:21.949671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed604b-77f8-40a6-b4f0-6c5b41265b60 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:21.955186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 458/907] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:21.961231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:21.972805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180424-c301-4c5a-8f1e-f86a8a549188 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.973428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180424-c301-4c5a-8f1e-f86a8a549188 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.973915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3180424-c301-4c5a-8f1e-f86a8a549188 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:21.976102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 459/908] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:21.980689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:21.980980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:21.981266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:22.000862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:22.002065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:22.046315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:22.095404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:22.095624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 460/909] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:22.099447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b077-8022-47a2-9043-f81e8b8a0588 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:22.115613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:22.140598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:22.142277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:22.143066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:22.143607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:22.144819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] RBAC: Adding query filter params (interface=public, service_id=14d4b6c3da4f4eae86f13b19f3fa5dc9, region_id=RegionOne) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:22.145740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:22.147860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:22.156319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 450/910] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:21 2022] GET /identity/v3/endpoints?service_id=14d4b6c3da4f4eae86f13b19f3fa5dc9&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:22.163280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:22.232102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32787-eff7-41c2-b0cb-cfb529ba8da7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:22.270277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:22.270947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:22.271274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:22.271711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:22.272440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:22.273802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3bfd-1d22-42a2-8f3c-33a3a0d838bb None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:22.288959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881ca7d-51ca-4d44-a3db-bdfb589180ad None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:22.296146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 461/911] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:22 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:22.336095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:22.337147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:22.337639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:22.338123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:22.339030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:22.340780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec0e6f-22aa-47e3-a7cc-479b44e24769 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:22.348675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 451/912] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:22 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:33:23.102940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53fdc-573f-4c9c-84cd-22f82caf8186 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.103512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53fdc-573f-4c9c-84cd-22f82caf8186 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.103512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53fdc-573f-4c9c-84cd-22f82caf8186 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.105313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 462/913] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:23.111385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.111797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.111982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.121902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafa0a-39cb-4553-85ec-7693648333de None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.122191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafa0a-39cb-4553-85ec-7693648333de None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.122464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafa0a-39cb-4553-85ec-7693648333de None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.124749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 463/914] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:23.129658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.129943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.130222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.130390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:23.131586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:23.147423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:23.148591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:23.154122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.176730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.221841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 452/915] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:23.228964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 464/916] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:23.244432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.256325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.361019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a37bb-9c51-4111-87b2-9cabe75653b8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.363574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbbe7f-2c26-4d08-ae39-123c0c22ab84 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.396623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.397443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.397737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.397988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.401329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.402371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.402856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.403389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.404452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.406568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.409663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:23.417805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:23.418845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:23.425589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 465/917] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:23.426522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:23.427808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:23.428654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 453/918] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:23.431727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.432402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.453757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.460907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.544340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53624bc9-41b8-41ca-8017-bc699d11b27f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.549295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec24e9-6965-40c2-a2f7-6ec1ee7666d9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.583419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.584589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.585220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.585782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.586464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.586959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:23.587276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.587625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.587852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.587969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.588803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:23.589172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.589932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.590652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.595639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 454/919] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:23.601500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.610923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 466/920] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:23.612275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.710335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.712366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.733817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b3a2-cf65-4334-87dc-ad7cb9e49f67 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.742304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3a98-35ec-4eef-85b3-812b8cebd77e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.769301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.770258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.770385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.770639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.781947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.783438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.788110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.789019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.789506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.789971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.791407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:23.792403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.794225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:23.804964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:23.805914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:23.806807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:23.806807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:23.806807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:23.806807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:23.807678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 455/922] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:23.808248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 467/922] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:23.809264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.809434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:23.918408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c5f2b-4a42-430e-a636-ba3a3a465a8a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.945707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161702-8149-4e3b-8bb9-dd6f07963d2c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:23.961318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.962974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.963507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.964218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.965380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:23.966281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.967946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.971668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:23.986036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:23.986821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:23.987111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:23.987434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:23.988344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:23.988805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 468/923] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:23.994160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:23.995730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.023215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 456/924] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:33:24.128807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c51843-3206-4dd1-9346-99b9ff2d1d2f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.175578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.175578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.175882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.176118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.183801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.185249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-bee3fbf3-166f-43fa-88cd-ea923aeb8b97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:24.200899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:24.201950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:24.203374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 469/925] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:24.208423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.211367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:24.319497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d70817-a0f4-456d-b246-4d2093f693ae None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.368288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.369308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.369908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.370387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.371460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:24.371992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.374233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.398996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 457/926] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:24.405198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e7b7-78e1-4d82-a753-c45a5b95fb3a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.405576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e7b7-78e1-4d82-a753-c45a5b95fb3a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.405858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e7b7-78e1-4d82-a753-c45a5b95fb3a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.406886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.407633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 470/927] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:24.413335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3df-ebf3-4298-84b7-eb9bdae49aa8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.413619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3df-ebf3-4298-84b7-eb9bdae49aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.413893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef3df-ebf3-4298-84b7-eb9bdae49aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.430985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6cbef3df-ebf3-4298-84b7-eb9bdae49aa8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:24.432128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6cbef3df-ebf3-4298-84b7-eb9bdae49aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:24.475673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:24.484829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:24.507464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 471/928] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:24.508912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3558fe4-efc4-41c0-84f3-7bdf590f7620 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.509233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3558fe4-efc4-41c0-84f3-7bdf590f7620 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.509504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3558fe4-efc4-41c0-84f3-7bdf590f7620 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.510913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 472/929] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:24.516253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.516542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.516826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.525166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50cae8-b9b7-4cdf-ac1c-1b398d82fb42 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.533614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:24.534813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:24.560930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.562848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.563313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.563589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.573905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.575395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:24.593079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:24.594152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:24.595077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:24.595077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:24.595077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:24.595077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.595077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 458/930] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:24.595422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.614306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 473/931] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:24.624715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.701523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f283-005b-4a53-b5fd-34a506187d2f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.715186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:24.732515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8659-8b00-436c-8015-0d74077c00b0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.739361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.740178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.740458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.741149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.741813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.743585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.746818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:24.757507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:24.758589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.759461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 459/932] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:24.760276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.777495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.778163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.778437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.778712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.779461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:24.779797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.781309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.793717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 474/933] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:24.794461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.871718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753e436-74e9-454d-90c4-e309d9909165 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.907446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccb39d-0c5b-45ce-affd-c75f09b77473 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:24.907623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.908251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.908531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.908805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.909482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.910858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:24.923195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:24.924329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:24.930152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 460/934] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:24.931217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.951057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:24.952487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:24.952778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:24.953122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:24.953893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:24.954197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:24.955574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:24.960687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 475/935] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:24.964840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:24.975827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.013335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.039176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf74f8-fe8d-4f00-be69-b82aca5d46b4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.079465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.080591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.080908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacbc01-b378-43d4-b265-2a6fa512e693 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.081268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.081725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.089149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.091071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:25.107695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:25.109327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:25.110218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 461/936] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:25.110729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.118449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.119121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.119435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.119715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.120420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:25.120729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.122100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.128529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 476/937] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:25.129334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.219949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.224110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c935-15b3-4046-bda3-44549085b000 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.239768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.243198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85ce7f-6a55-4b9d-9bc3-ced40902e9b0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.263975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.264777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.265064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.265340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.266054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:25.266362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.267762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.273051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 462/938] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:25.273051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.285206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.285999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.286169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.286414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.287340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:25.287597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.289016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.306853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 477/939] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:25.306853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.391212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292cb1-776e-409c-a4a8-362e4cb69d0e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.425696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c4fa-42dd-4c65-8693-42a0aaae1b86 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.425889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.426540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.426822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.427108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.427829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:25.428131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.429526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.439509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 463/940] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:25.439509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.465929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.466653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.468418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.468741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.469045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.470067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] RBAC: Adding query filter params (interface=public, service_id=49c824d5217e4b2f9f4783f079ac7f39, region_id=RegionOne) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:25.470331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.471874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.482031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 478/941] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:25 2022] GET /identity/v3/endpoints?service_id=49c824d5217e4b2f9f4783f079ac7f39&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:25.483257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.512217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.544004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100359b0-2b0a-4e12-af1b-6e784ed3f398 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.582166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.583052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.583361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.583633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/5522122a8e3b4d73a6331d90bf06c623/roles/9b1f23ffdb77452281a6ddc993884536` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.585849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=5522122a8e3b4d73a6331d90bf06c623, role_id=9b1f23ffdb77452281a6ddc993884536)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.587305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.594803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7e84-0134-47c8-97a9-a6985baf958d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.603768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 464/942] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:25 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/5522122a8e3b4d73a6331d90bf06c623/roles/9b1f23ffdb77452281a6ddc993884536 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:25.605319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:25.636987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.638233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.638840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.639871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.641011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.642517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22437278-72cc-41c9-8157-61b4df13e548 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.666661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 479/943] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:25.731668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:25.749132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e282-708c-4c37-9a46-6e0446af6fef None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:25.799002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:25.799895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:25.800254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:25.800601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:25.801378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:25.802852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9304a4-f4e5-4b0c-a382-d767edf5ae23 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:25.810334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 465/944] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:25 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:33:26.190623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478620ae-b464-49f2-8920-bc952b0a2fef None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:26.191165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478620ae-b464-49f2-8920-bc952b0a2fef None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:26.191275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478620ae-b464-49f2-8920-bc952b0a2fef None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:26.192860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 480/945] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:26.198130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:26.198426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:26.198708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:26.216136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:26.217384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:26.288654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 466/946] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:26.312908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478620ae-b464-49f2-8920-bc952b0a2fef None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:26.403656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:26.427392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478620ae-b464-49f2-8920-bc952b0a2fef None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:26.462127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:26.462724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:26.463009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:26.463321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:26.464044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:26.465560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:26.466936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING keystone.server.flask.common [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 05:33:26.487685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.sql.core [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:33:26.487685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 05:33:26.487685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [parameters: {'id': '96dfb9a0b1764edbbc33ea84d687ede7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 05:33:26.487685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86778) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96dfb9a0b1764edbbc33ea84d687ede7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96dfb9a0b1764edbbc33ea84d687ede7. Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:33:26.495601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result.read() Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 05:33:26.496428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application yield resource Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise self.value Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application session.commit() Jul 25 05:33:26.497404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:33:26.498353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:33:26.499412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application result.read() Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:33:26.500237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [parameters: {'id': '96dfb9a0b1764edbbc33ea84d687ede7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:26.501128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:26.501925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96dfb9a0b1764edbbc33ea84d687ede7. Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:26.502850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 481/947] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 25 05:33:26 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:26.511033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:26.594837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:26.617535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179582-8ea2-4ca9-b96f-331a4cc48976 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:26.653580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:26.654389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:26.654797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:26.655266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:26.662342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:26.663828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-e8158024-2b93-4cdf-bde0-3410b7515e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:26.677831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:26.678725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:26.679666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 467/948] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:26.688455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:26.796505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2d03-c1f5-4aff-ac00-43bc86a597d3 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:26.832065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:26.832735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:26.833019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:26.833296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:26.834054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:26.834363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:26.836060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9556b-64ed-4531-86c9-832f3e46a7aa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:26.839862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:26.858812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 482/949] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:27.725896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157980-70be-441e-988f-c749ce92d439 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.726390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157980-70be-441e-988f-c749ce92d439 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.726390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157980-70be-441e-988f-c749ce92d439 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:27.728061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 468/950] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:27.733685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422f28-3f47-4f80-bdd7-5912d77a632f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.734129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422f28-3f47-4f80-bdd7-5912d77a632f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.734310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e422f28-3f47-4f80-bdd7-5912d77a632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:27.751854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1e422f28-3f47-4f80-bdd7-5912d77a632f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:27.753384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1e422f28-3f47-4f80-bdd7-5912d77a632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:27.823552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 483/951] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:27.847747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8157980-70be-441e-988f-c749ce92d439 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:27.890027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a23d5-8c79-4697-9f5b-adb8c5c56333 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.890356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a23d5-8c79-4697-9f5b-adb8c5c56333 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.890581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a23d5-8c79-4697-9f5b-adb8c5c56333 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:27.892283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 484/952] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:27.897345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98817-80ce-452e-a16b-ed6f7840899f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.897630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98817-80ce-452e-a16b-ed6f7840899f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.897905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f98817-80ce-452e-a16b-ed6f7840899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:27.914840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-17f98817-80ce-452e-a16b-ed6f7840899f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:27.916064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-17f98817-80ce-452e-a16b-ed6f7840899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:27.961339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8157980-70be-441e-988f-c749ce92d439 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:27.991025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 485/953] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:27.996085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:27.996904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.997147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba65-0beb-4802-a46c-35cf42cc2b54 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:27.997250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.997452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:27.998005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba65-0beb-4802-a46c-35cf42cc2b54 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:27.999119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cba65-0beb-4802-a46c-35cf42cc2b54 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.003027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 486/954] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:28.007401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.007819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.008250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.011554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:28.017339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:28.022500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:28.023911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:28.024937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.027236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:28.027496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 469/955] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:28.028671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:28.028873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.086256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.104875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 487/956] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:28.112330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.137602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7dc2f-f196-4d09-bb74-3a74710efa74 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.176787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.177584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.177868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.178145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.178797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.180376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:28.192699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:28.193840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:28.194787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.198922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 470/957] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:28.199621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.227963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e1c3-0798-45b7-86f9-c0d92e27d943 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.262867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.263515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.263796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.264739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.265179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.266572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.266909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.268446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.283164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 488/958] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.283164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.310462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873b97a-8ebb-42c9-ab66-f07c44b72b58 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.330832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.352154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.353091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.353373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.353645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.354299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.355705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:28.367785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:28.368904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.369801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 471/959] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:28.370627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.394087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340120-eebf-4754-90ca-fb422f71bdd6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.431956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.432657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.432943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.433222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.433922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.434230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.435622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.441261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 489/960] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.442020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.480987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a794-e6aa-471b-a0bd-456fe03226e0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.507795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.517556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.518293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.518579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.518855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.530828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.532442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.547953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c362-7818-4dac-956f-90facce11e6e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:28.551159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:28.552041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 472/961] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:28.557866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.566022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.591736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.593297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.593586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.594662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.595418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.595736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.597119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.608900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 490/962] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.608900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.661797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668b34-ce23-466b-b58c-0c33f0d0e9e9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.697818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.698489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.698777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.699055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.699797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.700109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.701601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.706203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 473/963] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.706995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.731200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add639f-3531-4121-8eec-1f994c40131c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.775562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.776978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.777351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.777791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.778259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.779312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.780371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.782323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.796866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 491/964] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.802749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.845858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488af184-779c-4669-b5fb-3488b722f6f1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.853127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:28.893999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.894678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.894985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.895278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:28.896280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:28.896280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:28.897665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:28.905987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 474/965] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:28.912125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:28.944764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdad9f-2482-4e63-b478-85b9db2d133a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:28.991749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:28.993240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:28.993935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:28.994843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.005917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.007421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8d988d82-7414-4489-b127-c0efc3387139 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:29.023880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:29.024878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:29.025871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 492/966] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:33:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:29.027108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de2e9e-5b7c-4f1f-9a6f-70b05915b1eb None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.027108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de2e9e-5b7c-4f1f-9a6f-70b05915b1eb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.027108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de2e9e-5b7c-4f1f-9a6f-70b05915b1eb None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.028360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 493/967] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:29.032250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de2e9e-5b7c-4f1f-9a6f-70b05915b1eb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.042301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b8a6-4d1a-425d-a937-565467fd18ff None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.050343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.079090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.079845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.080131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.080411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.081184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.082660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea602-d19b-4fb6-ac80-6ceb194a19c7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.111923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 475/968] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:29.113203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.113493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.113868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.132446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:29.133671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:29.174727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.190478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de2e9e-5b7c-4f1f-9a6f-70b05915b1eb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.232897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.233798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.234085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.234362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.235394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:29.235639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.237228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.243173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 476/969] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:29.263118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 494/970] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:29.268900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.276807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.379170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.390965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704008-dd09-4a6b-aab9-cb18c3ef00a8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.410272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602649-eaf7-49e4-8590-120d0e2bd11e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.429991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.431014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.431542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.432031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.432953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.434634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.436794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING keystone.server.flask.common [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 05:33:29.449986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.sql.core [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:33:29.449986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 05:33:29.449986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [parameters: {'user_id': '1e7816d393ef4126b02f2aca9b35b47d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 05:33:29.449986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86779) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:33:29.453412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.454074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.454401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.454680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application result.read() Jul 25 05:33:29.471184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:33:29.472163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application yield resource Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise self.value Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application session.commit() Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:33:29.473196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:33:29.474123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:33:29.475039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application result.read() Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:33:29.478230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [parameters: {'user_id': '1e7816d393ef4126b02f2aca9b35b47d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:29.480343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 05:33:29.483504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 477/971] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 05:33:29 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:29.485607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.497025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.565153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.567512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.609957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d5b53-2a17-4a59-a99d-050905e18944 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.658591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.659986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.660424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.661108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.672263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.675066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.683055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 495/972] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:29.684214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:29.695953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:29.697133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:33:29.698289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:29.705073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 478/973] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:29.706075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.723198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.761396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:29.823648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b3095-f5c4-4a92-8bd9-c3036cdef994 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.830376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c341f6-157c-4fb8-ad56-a86267bb4db1 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:29.865179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.866187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.866567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.867013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.873301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:29.874026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:29.874316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:29.874592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:29.875478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:29.875794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.878608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.880875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:29.882488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:29.905310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:29.906554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:29.907663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:29.907663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:29.907663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:29.907663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:29.913415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 496/974] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:29.916095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:29.923989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 479/975] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:30.033052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cedd0-74c1-4593-a5bb-948bbb79a25a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:30.034982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:30.073434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:30.074426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.074862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.075321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.076221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:30.077210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:30.078740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:30.091528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 497/976] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:30.097926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:30.174055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:30.205030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87123a6-261c-41cd-912f-ccf714155f5f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:30.240154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:30.240957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.241242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.241521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.248511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:30.250038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:30.263907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:30.264957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:30.266298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 480/977] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:30.271333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:30.377869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b4ee-21df-4840-81d7-3962bdd99fa1 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:30.415751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:30.416431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.416717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.416993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.417785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:30.418096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:30.419557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bd813-2697-4e33-9a3f-60107057062c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:30.439234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 498/978] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:30.441372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:30.543757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24269-af74-4687-b65c-4c43ca686e0b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:30.573890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:30.580180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:30.580850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.581134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.581413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.582240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] RBAC: Adding query filter params (role.id=9b1f23ffdb77452281a6ddc993884536, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=5522122a8e3b4d73a6331d90bf06c623) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:30.582554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:30.584009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fcfc-de12-41bc-97a8-a49835f81bbf None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:30.595213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 481/979] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:30 2022] GET /identity/v3/role_assignments?user.id=5522122a8e3b4d73a6331d90bf06c623&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=9b1f23ffdb77452281a6ddc993884536 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:30.870809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d75b83-483a-472d-b6a0-5843e4b1e2bc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.871361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d75b83-483a-472d-b6a0-5843e4b1e2bc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.871439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d75b83-483a-472d-b6a0-5843e4b1e2bc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.872894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 499/980] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:30.878183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1af3b-3ef3-4bd3-845c-a24104fe32a9 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:30.878610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1af3b-3ef3-4bd3-845c-a24104fe32a9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:30.878803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1af3b-3ef3-4bd3-845c-a24104fe32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:30.895554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8bc1af3b-3ef3-4bd3-845c-a24104fe32a9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:30.897052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8bc1af3b-3ef3-4bd3-845c-a24104fe32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:30.964121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 482/981] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:30.988344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d75b83-483a-472d-b6a0-5843e4b1e2bc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:31.013567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:31.097081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d75b83-483a-472d-b6a0-5843e4b1e2bc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:31.133033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48705980-f741-4762-9948-2de08786b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:31.133819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48705980-f741-4762-9948-2de08786b226 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.134227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48705980-f741-4762-9948-2de08786b226 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.134508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48705980-f741-4762-9948-2de08786b226 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.135264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48705980-f741-4762-9948-2de08786b226 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:31.136620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48705980-f741-4762-9948-2de08786b226 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:31.151087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 500/982] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:30 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:31.222810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f1f3-0ef6-4ec5-a60d-ae0808fb4b81 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.223204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f1f3-0ef6-4ec5-a60d-ae0808fb4b81 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.223416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f1f3-0ef6-4ec5-a60d-ae0808fb4b81 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.225025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 483/983] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:31.230829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.231173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.231433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.249287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:31.250505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:31.332399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 501/984] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:31.355640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9f1f3-0ef6-4ec5-a60d-ae0808fb4b81 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:31.461134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9f1f3-0ef6-4ec5-a60d-ae0808fb4b81 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:31.487336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:31.497059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:31.497911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.498253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.498700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.499596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:31.501021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:31.513231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:31.514769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:31.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 484/985] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:31.524452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:31.535675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:31.631576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45515f2e-6192-4d72-86a9-d53d2a92164b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:31.666687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:31.667395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.667681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.667957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.668661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:31.668967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:31.670374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:31.680003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 502/986] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:31.681274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:31.786260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c636af4-55a5-4223-b91f-57c487841b18 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:31.819850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:31.820521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.820801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.821076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.821783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:31.822087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:31.823477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:31.834115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 485/987] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:31.835074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:31.908125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:31.939075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf45a-802c-4f22-a840-6f3b4235a97c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:31.973249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:31.973915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:31.974186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:31.974459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:31.975283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] RBAC: Adding query filter params (interface=admin, service_id=49c824d5217e4b2f9f4783f079ac7f39, region_id=RegionOne) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:31.975850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:31.977202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018e7c-289f-4a34-a0bf-43dddbd236f7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:31.987239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 503/988] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Jul 25 05:33:31 2022] GET /identity/v3/endpoints?service_id=49c824d5217e4b2f9f4783f079ac7f39&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:31.988462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:32.049244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:32.095337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c624-b64b-4b3d-b946-ae8ae0ad0fc0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:32.128378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:32.129045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:32.129335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:32.129619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:32.130301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:32.131713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64718b21-05bd-4e27-a9d7-e07271bcc8e1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:32.143220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 486/989] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:31 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:33:32.686859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62824-8c52-437a-935d-9b564f83a24c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:32.687056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62824-8c52-437a-935d-9b564f83a24c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:32.687365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62824-8c52-437a-935d-9b564f83a24c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:32.688818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 504/990] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:32.694273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:32.694633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:32.694988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:32.713228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:32.714402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:32.784103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 487/991] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:32.807493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62824-8c52-437a-935d-9b564f83a24c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:32.913457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62824-8c52-437a-935d-9b564f83a24c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:32.947459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:32.948184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:32.948463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:32.948737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] PATH_INFO: `/v3/services/image` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:32.949410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:32.950770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:32.953921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:32.964761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:32.965755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:32.966602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:32.971306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 505/992] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 05:33:32 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:32.972727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.022145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:33.073865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a568d0-7fcb-4bed-b5a8-541d2d7f2a48 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.108872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.109540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.109826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.110101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.110805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] RBAC: Adding query filter params (name=image) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:33.111111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.112496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f12833-870c-4e9d-a7cb-2a38bfd1eab1 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:33.121927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 488/993] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:33.122898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.226473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37118d8c-eef5-470f-b58f-ae7ed298933b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.234066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911aeae-a24f-4848-8a0c-dbba2aae36c2 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.234354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911aeae-a24f-4848-8a0c-dbba2aae36c2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.234634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911aeae-a24f-4848-8a0c-dbba2aae36c2 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.236189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 489/994] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:33.241129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.241416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.241694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.260829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:33.262055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:33.266341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.267017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.267326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.267606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.268316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] RBAC: Adding query filter params (type=image) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:33.268622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.269989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:33.275005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 506/995] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:33.350466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 490/996] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:33.374202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.444757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:33.485228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1036c-efc7-4e9d-ab97-205739e541ee None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.518493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.519325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.519609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.519888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.520537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.521906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:33.533527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:33.534511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:33.535387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:33.539203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 507/997] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:33.541152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.584366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:33.644609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d62049-ba77-453b-8042-aeb1a908166b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.678270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.678942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.679253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.679538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.680243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:33.680550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.681912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:33.687992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 491/998] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:33.693598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.797863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906607d6-44fd-4c51-9cb8-71182ad2c118 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.824616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:33.834270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.834942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.835252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.835533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.836238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:33.836549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.837910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:33.848113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 508/999] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:33.849171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:33.949866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf00ac-7204-49c2-80d3-219717fa9603 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:33.958090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:33.987205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:33.987868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:33.988152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:33.988426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:33.989212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] RBAC: Adding query filter params (interface=public, service_id=45bcde5992194e9d851dbce88084cee6, region_id=RegionOne) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:33.989524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:33.990892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c4b1-97a8-49fe-8b46-59804f582edb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.000570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 492/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:33 2022] GET /identity/v3/endpoints?service_id=45bcde5992194e9d851dbce88084cee6&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:34.001786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:34.108961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd9ef-47a5-48a2-866b-6f1c16dd7e68 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:34.142834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:34.143533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.143819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.144097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.144782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:34.146147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042c40-d302-4826-92ad-785b537e86ff None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.153726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 509/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:34 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:33:34.199898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744787f-b123-4635-86a2-041e26183916 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.200438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744787f-b123-4635-86a2-041e26183916 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.200438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744787f-b123-4635-86a2-041e26183916 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.202261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 493/1002] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:34.208211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.208518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.208772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.226856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:34.228101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:34.283250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:34.302823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 510/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:34.325581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744787f-b123-4635-86a2-041e26183916 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:34.441639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744787f-b123-4635-86a2-041e26183916 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:34.480848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:34.481659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.481943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.482222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.483527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:34.484923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:34.496820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:34.497822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:34.499264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 494/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 05:33:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:34.504804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:34.603544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95c5f-ae42-4ae0-90df-21ad9bceaf02 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:34.638173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:34.638874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.639595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.639595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.640133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:34.640436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:34.641784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.646817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 511/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:34.652236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:34.687683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:34.755198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb43a-11ca-4622-a947-fc19c14b7346 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:34.788197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:34.788862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.789143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.789418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.790118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:34.790422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:34.791881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0041e9-a647-494b-b973-7083e3572c99 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.802177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 495/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 05:33:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:34.803408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:34.857101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:34.909856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78371e-399c-4e2d-b604-834bb28c9ba8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:34.944356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:34.945024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:34.945308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:34.945585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:34.946320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:34.947723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89b3d-a0cd-424e-bba6-54bc2d944e92 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:34.971168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 512/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:35.331687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9cb7e-9112-4b11-bfc4-2e28eed69240 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:35.332225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9cb7e-9112-4b11-bfc4-2e28eed69240 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:35.332225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9cb7e-9112-4b11-bfc4-2e28eed69240 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:35.335651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 496/1008] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:35.339190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786219-4996-49ae-9292-8173de4940d5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:35.339614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786219-4996-49ae-9292-8173de4940d5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:35.339784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786219-4996-49ae-9292-8173de4940d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:35.357352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5f786219-4996-49ae-9292-8173de4940d5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:35.359318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5f786219-4996-49ae-9292-8173de4940d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:35.433589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 513/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:35.455262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9cb7e-9112-4b11-bfc4-2e28eed69240 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:35.554755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:35.560580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9cb7e-9112-4b11-bfc4-2e28eed69240 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:35.594254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:35.594855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:35.595157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:35.595436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:35.596178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:35.597536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2828e2-a612-4586-bd73-8e2037eb0895 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:35.612821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 497/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:35 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:36.207746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626730d2-fff6-494f-82ac-7b49c4b0df0c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.208077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626730d2-fff6-494f-82ac-7b49c4b0df0c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.208304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626730d2-fff6-494f-82ac-7b49c4b0df0c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.209833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 514/1011] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:36.214906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.215230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.215517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.232999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:36.234191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:36.307087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 498/1012] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:36.331286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626730d2-fff6-494f-82ac-7b49c4b0df0c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:36.375501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:36.444545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626730d2-fff6-494f-82ac-7b49c4b0df0c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:36.484760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:36.485478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.485762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.486039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.486684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:36.488076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:36.500295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:36.501298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:33:36.502153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:36.506351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 515/1013] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:36.507613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:36.591604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:36.609744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937877a3-4aed-439c-9508-709b6fa66268 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:36.644233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:36.644904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.645186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.645461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.646161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] RBAC: Adding query filter params (name=compute) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:36.646468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:36.647863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:36.657678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 499/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:36.658730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:36.766241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:36.770040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9321-a37b-4699-9948-2d17f49eb35e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:36.805073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:36.805738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.806020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.806294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.806992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:36.807325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:36.808698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992190cc-20af-44d1-bb92-2175bf48e56a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:36.819190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 516/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 05:33:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:36.820415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:36.923510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbdc9a-831e-4615-aa71-57b461b8449c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:36.957004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:36.957665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:36.957945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:36.958221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:36.959013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:36.960413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0395a4-a6ff-42e7-a8da-4612f8329122 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:36.980385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 500/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:37.033430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5970d6-8133-4965-97b1-767c2ad2bab6 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.033738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5970d6-8133-4965-97b1-767c2ad2bab6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.033919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5970d6-8133-4965-97b1-767c2ad2bab6 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.035616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 517/1017] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:37.041189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649c460-dc12-42d3-821d-64906423c675 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.041484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649c460-dc12-42d3-821d-64906423c675 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.041768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649c460-dc12-42d3-821d-64906423c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.048534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:37.062809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5649c460-dc12-42d3-821d-64906423c675 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:37.064095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5649c460-dc12-42d3-821d-64906423c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:37.143729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 501/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:37.167387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5970d6-8133-4965-97b1-767c2ad2bab6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:37.280813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5970d6-8133-4965-97b1-767c2ad2bab6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:37.316994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:37.317722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.318005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.318278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.319492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:37.320927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7077e-6064-43f8-ae0d-aa67315d6242 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:37.327200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 518/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:37.328987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649c460-dc12-42d3-821d-64906423c675 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:37.436252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649c460-dc12-42d3-821d-64906423c675 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:37.464777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:37.471887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:37.472560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.472843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.473120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.473843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:37.475304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86e511-f9fa-43ea-a4f4-82b8c6a38d0b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:37.511165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 502/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:33:37 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:37.698945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22a63-8647-4698-9141-af23764912ad None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.699514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22a63-8647-4698-9141-af23764912ad None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.699514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22a63-8647-4698-9141-af23764912ad None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.701025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 519/1021] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:37.706257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.706551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.706836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.724420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:37.725871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:37.795803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 503/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:37.818568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22a63-8647-4698-9141-af23764912ad None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:37.850885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:37.924787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22a63-8647-4698-9141-af23764912ad None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:37.959643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:37.960371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:37.960657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:37.960936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] PATH_INFO: `/v3/services/image` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:37.961585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:37.962942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:37.975098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:37.976383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:37.977867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 520/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 05:33:37 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:37.984376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:38.086547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7e4d5-34b4-42ce-99e7-7c85bdf0d3f8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:38.100466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:38.124579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:38.125246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:38.125533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:38.125813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:38.126518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] RBAC: Adding query filter params (name=image) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:38.126828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:38.128234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:38.137912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 504/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:38.139837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:38.235529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:38.241633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e7e95-4c20-4b06-b9b9-be076195a600 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:38.279657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:38.280343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:38.280539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:38.280809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:38.281506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:38.281807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:38.283172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:38.293237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 521/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:38.294148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:38.403797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346abcf8-de50-47ae-a5e0-ac633a48a4eb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:38.438054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:38.438701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:38.438978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:38.439354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:38.440132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] RBAC: Adding query filter params (interface=public, service_id=dc166c6aa36b4ac69e3c6af745baae46, region_id=RegionOne) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:38.440441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:38.441791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5e83-9727-43e6-a2f2-89a26dc0f9ed None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:38.446995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 505/1026] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:33:38 2022] GET /identity/v3/endpoints?service_id=dc166c6aa36b4ac69e3c6af745baae46&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:38.452656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:38.552139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513c55-7b57-459c-a27f-e84c921ed0a3 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:38.584948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:38.585607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:38.585886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:38.586161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:38.586835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:38.588214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02baf4-ba8d-4477-a5af-3c0b503c970d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:38.595550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 522/1027] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:33:38 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:33:39.194454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e3-d408-4459-84ca-ec1e27bae854 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.195023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e3-d408-4459-84ca-ec1e27bae854 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.195023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896f1e3-d408-4459-84ca-ec1e27bae854 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.196570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 506/1028] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:39.202229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.202639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.202823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.219414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:39.220613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:39.238975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:39.291387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 523/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:39.315722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f1e3-d408-4459-84ca-ec1e27bae854 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.370295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:39.430860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896f1e3-d408-4459-84ca-ec1e27bae854 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:39.465316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:39.466068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.466355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.466632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.477621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-ede54e86-5510-4a26-a59d-84156b587cf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:39.485823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:39.486761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:39.487946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:39.491449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:39.493012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.593227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a1567-efac-4d83-b951-dafa015cec15 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:39.628449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:39.629409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.629904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.630373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.631324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:39.631808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:39.633353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:39.647304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 524/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:39.648281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ad0e-4a8f-431e-8a04-c8bb9b5003ca None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.648569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ad0e-4a8f-431e-8a04-c8bb9b5003ca None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.648849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ad0e-4a8f-431e-8a04-c8bb9b5003ca None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.649096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.650238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 508/1032] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:39.656412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.656773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.657123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.671662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:39.674014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:39.675306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:39.753106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 509/1033] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:39.768089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c230546-fbd2-45a3-96f0-f4b46c1d30f2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:39.778330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.807742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:39.808878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.809316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.809593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.810231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:39.821284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:39.822723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:39.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:39.843939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:39.845016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:39.845016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:39.845016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:39.845016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:39.845016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 525/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:39.849828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.889453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf082cf6-b1f2-4869-a41a-0e92f9d3167f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:39.924567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:39.926684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:39.927706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:39.927991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:39.928269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:39.929449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:39.930875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:39.932540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 510/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:39.939372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:39.963713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0b5ac-124d-4341-a61f-7dd9a8f38d66 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.000213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.001173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.001453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.001730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.002453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:40.002761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.004222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.017433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 526/1036] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:40.022868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.052992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:40.057579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376a57-61fc-4e96-9d0b-9f9a6d709161 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.095903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.096580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.096864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.097467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.097852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.099320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.122722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 511/1037] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:33:39 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:33:40.134865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ba52d-d84a-4246-8c5f-4b50a4a11a6c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.167370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:40.177720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.178600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.178886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.179181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.187999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.189477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:40.205971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:40.207498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:40.208465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:40.209746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 527/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:40.213173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.321260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487da4-b500-4385-938b-98f5927e8a48 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.361782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.362469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.362753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.363029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.363912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:40.364222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.365652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2c974-3c91-4e9d-b06b-05170a30d33e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.385098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 512/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:40.390792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.500170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cadca-ed0c-46a6-9be9-f20c1d371c53 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.534071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.534716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.534997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.535303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.591015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:40.605033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.606480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.646974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718fe89-4ff4-4408-91ae-648a6aefb99e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.647384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718fe89-4ff4-4408-91ae-648a6aefb99e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.647583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718fe89-4ff4-4408-91ae-648a6aefb99e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.649180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 513/1040] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:40.653799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.654095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.655002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.672166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:40.673411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:40.682835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:40.710107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 528/1041] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:40.717497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.761009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 514/1042] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:40.784671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.812899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:40.825822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a595f-c66d-4053-933a-f48745ff2667 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.864749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.865801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.866235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.866663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.877347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.878946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.892088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37677-e081-4b72-b054-df8684a3b72e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:40.897970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:40.899054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:40.900038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:40.900038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:40.900038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:40.900038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:40.900038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 529/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:40.905431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.934160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:40.934949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:40.935253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:40.935521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:40.936175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:40.937523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:40.949297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:40.950468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:40.951978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 515/1044] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:40.956982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:40.969421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.018010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e61d8-5086-40c2-a9da-b6164296f1b8 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.054837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.055669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.056057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.056342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.057060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:41.057371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.058739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.067758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.075883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968be15-55f9-47e6-b37b-fa179fdcdec9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.077234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 530/1045] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:41.078729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:41.116167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.116913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.117287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.117661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.118459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:41.118887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.120351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.126001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 516/1046] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:41.131469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:41.196496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc4bd7-506d-44c4-8277-62afc37f10ef None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.205273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.233412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.234530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.234943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.235254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.240169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7438-96a7-418f-89bd-290578ba63e2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.242395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.243866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:41.258166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:41.259397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:41.260451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 531/1047] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:41.265685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:41.280521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.281183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.281464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.281738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.282451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] RBAC: Adding query filter params (type=image) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:41.282752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.284148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.293688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 517/1048] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:41.294673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:41.332271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.385768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c8c2-1919-4e47-b439-8c9ae0368627 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.413764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f651-2aa1-4297-89d8-25d205b74cf8 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.425521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.426512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.426997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.427606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.429078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:41.429675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.431739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.452031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.452031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.452031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.452031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.452422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.452422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6af8a-d347-409a-8dc5-d1618f64c4cc None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.452550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 532/1049] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:41.453214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:41.455347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.474027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 518/1050] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:33:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:41.568348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73b9de-6108-4125-bb8c-14bde6e1cc26 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:41.589744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:41.613939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:41.614607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:41.614893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:41.615200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:41.616382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] RBAC: Adding query filter params (role.id=9b1f23ffdb77452281a6ddc993884536, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:41.616382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:41.617770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62451e-be7e-4bd9-bc7d-a81a36130cc1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:41.627191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 533/1051] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:41 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=9b1f23ffdb77452281a6ddc993884536 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:42.240452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a163-6ce4-4645-ab9f-c6c1bed84161 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:42.240995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a163-6ce4-4645-ab9f-c6c1bed84161 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:42.240995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a163-6ce4-4645-ab9f-c6c1bed84161 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:42.242519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 519/1052] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:42.247694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:42.248618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:42.248893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:42.265923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:42.267099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:42.338784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 534/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:42.361853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a163-6ce4-4645-ab9f-c6c1bed84161 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:42.466276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a163-6ce4-4645-ab9f-c6c1bed84161 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:42.500256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:42.500986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:42.501270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:42.501546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:42.511939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:42.520051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:42.520969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:42.526839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 520/1054] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:42.530163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:42.632685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd906f-bb4f-4b55-b52a-47858844e4d8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:42.644477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:42.669883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:42.670655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:42.670950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:42.671268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:42.672017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:42.672324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:42.673685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:42.687096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 535/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:42.688723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:42.744039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:42.797156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfca87a-0d76-492b-a735-cd04d0cc2671 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:42.830890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:42.831805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:42.832088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:42.832362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] PATH_INFO: `/v3/users/28950f803ef24ac292139b32a3317d24` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:42.848197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] RBAC: Authorizing `identity:get_user(user_id=28950f803ef24ac292139b32a3317d24)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:42.849681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:42.857263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 521/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:42 2022] GET /identity/v3/users/28950f803ef24ac292139b32a3317d24 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:42.858750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:42.977033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038248-ffbd-4768-a320-58ba9a50e884 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:43.016701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:43.017695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.018155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.018609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.062912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:43.091032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:43.093485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:43.198099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 536/1057] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:43.204440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:43.312496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb59487-e1b4-417e-afaf-17d0db22608a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:43.325832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:43.353781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:43.354649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.354933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.355235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.356421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:43.358439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a22d9-87df-434d-be69-851b2333e1ac None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:43.365230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 522/1058] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:33:43 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:43.366478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:43.439077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:43.470356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d986-12fd-41cb-bb5a-49ca3c736418 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:43.504398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:43.505051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.505332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.505606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.506431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=0dce0f97ffb940ffa52bef1375645c39, user.id=28950f803ef24ac292139b32a3317d24) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:43.506741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:43.508208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c040c-9dc5-4bee-8f07-dcb6bf2e263b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:43.523534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 537/1059] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:43 2022] GET /identity/v3/role_assignments?user.id=28950f803ef24ac292139b32a3317d24&scope.project.id=0dce0f97ffb940ffa52bef1375645c39&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:43.565629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424497-a54d-479b-a42a-ed2ea33f724d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.565909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424497-a54d-479b-a42a-ed2ea33f724d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.566183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56424497-a54d-479b-a42a-ed2ea33f724d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.567644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 523/1060] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:43.573686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.574026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.574318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.594043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:43.595275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:43.671549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec8a6-2d2d-4e58-8018-c4b86bcb42ae None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.671830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec8a6-2d2d-4e58-8018-c4b86bcb42ae None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.672107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec8a6-2d2d-4e58-8018-c4b86bcb42ae None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.673479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 524/1061] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:43.677081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 538/1062] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:43.679014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.679347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.679627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.696664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:43.697893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:43.700300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:43.771436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:43.779396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 525/1063] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:43.794761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:43.807527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafae631-01fe-4705-8b3c-4b263186b492 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:43.844719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:43.845295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.845574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.845851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.899675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09063fc-3823-4c2d-af07-1c1fdadd5997 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:43.909249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:43.917903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:43.919388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:43.944504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:43.945618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:43.945904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:43.946178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:43.958877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:43.968111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:43.969086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:43.969943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:43.971204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 526/1064] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:43.975865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:43.986078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.023623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 539/1065] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:44.029776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.089702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc7c7-d205-4410-9eb7-6d654f1729b7 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.125020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.125620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.125905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.126185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.126933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:44.127275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.128660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.137166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 527/1066] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:44.138995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f54e9-1603-4d71-95c6-e652a2e77dc6 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.143962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.175560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.178457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.179295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.179572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.179846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.190325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.192111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:44.210494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:44.211486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:44.212382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:44.212382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:44.212382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:44.212382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:44.212382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 540/1067] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:44.218414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.238136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.259368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7323-5cd8-4ef9-95d7-70fde2e3d34f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.294211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.295540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.295819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.296090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.306303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.307765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.325130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86dc5-77ef-40b8-b62c-c3664b65f5bd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:44.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:44.327199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:44.328360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:44.328360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:44.328360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:44.328360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:44.328360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 528/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:44.332679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.370343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.371696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.372216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.372687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.373482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:44.373792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.375224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.395167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 541/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:44.429402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.452471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9de8c-a7e7-4bef-9be4-bc50f6f208e3 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.489389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.490070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.490370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.490625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.491381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:44.491689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.493071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.511570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 529/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:44.512876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.598431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.621627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e03aa-f609-48b5-8ac7-c72db0896f4b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.659732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.660450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.660736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.661014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.670564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.672053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:44.686473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:44.687600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:44.688600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 542/1071] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:44.693639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.790838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c25f08-7ddf-4562-95a2-794fb822413a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.823139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.823837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.824123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.824403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.825240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:44.825554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.827641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:44.836139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.845794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 530/1072] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:44.851695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:44.948714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c554-f2da-4288-92d8-db2279c61f5c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:44.982002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:44.982818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:44.983097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:44.983398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:44.990537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:44.995235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:44.996681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:45.013318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:45.014775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:45.016266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:45.016266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:45.016266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:45.016266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:45.016266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 543/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:45.021067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.119955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716194d-12d7-4cb8-b44c-3a8d6cb0a171 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.155065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.155850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.156131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.156404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.157118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:45.157423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:45.158789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.170747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 531/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:45.176268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.274001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e52f2-afcc-4d7c-a6bd-e3a19b54f3f4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.307409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.308204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.308486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.308763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.315469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:45.316901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:45.330893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:45.331967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:45.332898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 544/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:45.338167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.395101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:45.436895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f9ba-8f3e-482b-aed8-a90e4e4d1889 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.469601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.470253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.470532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.470806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.471619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:45.471928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:45.473344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e881-600c-42d7-8d9b-de9a2cfd4d4c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.486547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 532/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:45.492520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.542128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:45.556223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81029-1b10-438c-863f-09849c7dcf8e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.556511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81029-1b10-438c-863f-09849c7dcf8e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.556788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81029-1b10-438c-863f-09849c7dcf8e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.558162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 533/1077] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:45.563810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.564093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.564370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.580490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:45.581710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:45.593164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e3840-47b7-4bc3-a0c9-96024da33bf4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.628377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.629288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.629569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.629844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/9b1f23ffdb77452281a6ddc993884536` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.632058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=e82ecd4a337d4c088cf4a45d8c49534a, role_id=9b1f23ffdb77452281a6ddc993884536)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:45.633487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.646699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 545/1078] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:45 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/e82ecd4a337d4c088cf4a45d8c49534a/roles/9b1f23ffdb77452281a6ddc993884536 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:45.655044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 534/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:45.675256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.782610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820e98-f34a-4529-a6a4-faf3849677be None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.793959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:45.820380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.821184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.821466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.821744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.831887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:45.839508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:45.840626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:45.842025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 546/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:45.847542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:45.896406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:45.945936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576c0c-f883-47cb-a359-7ab5f0055ac5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:45.979405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:45.980075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:45.980357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:45.980634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:45.981379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:45.981687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:45.983178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:45.991363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 535/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:45.997199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:46.099855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d209c0-2277-40e7-aa13-db58d7593626 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:46.134309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:46.135221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:46.135508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:46.135788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] PATH_INFO: `/v3/users/28950f803ef24ac292139b32a3317d24` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:46.136993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] RBAC: Authorizing `identity:get_user(user_id=28950f803ef24ac292139b32a3317d24)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:46.138539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:46.140724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 547/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:45 2022] GET /identity/v3/users/28950f803ef24ac292139b32a3317d24 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:46.146504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:46.244169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55543f5-e529-4798-a832-2755fc39f14c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:46.254613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:46.278896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:46.280515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:46.280798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:46.281076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:46.282266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:46.283739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb4bc6-bb78-4334-9dc1-5797b8001352 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:46.285618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 536/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:33:46 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:46.291421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:46.331684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:46.395728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658990-7ba4-4626-a351-d3e71a72a611 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:46.428783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:46.429669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:46.429948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:46.430222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39/users/28950f803ef24ac292139b32a3317d24/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:46.432191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dce0f97ffb940ffa52bef1375645c39, user_id=28950f803ef24ac292139b32a3317d24, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:46.433611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995129-f6c7-4d8e-8966-fda5ac486989 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:46.446130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 548/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:46 2022] PUT /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39/users/28950f803ef24ac292139b32a3317d24/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:47.657698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a2ab-751d-47f7-80b6-6350ddec1ed9 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:47.658247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a2ab-751d-47f7-80b6-6350ddec1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:47.658247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a2ab-751d-47f7-80b6-6350ddec1ed9 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:47.659573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 537/1085] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:47.664903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:47.665320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:47.665464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:47.681846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:47.683031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:47.749494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 549/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:47.772504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a2ab-751d-47f7-80b6-6350ddec1ed9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:47.872252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a2ab-751d-47f7-80b6-6350ddec1ed9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:47.905814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:47.906629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:47.906913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:47.907223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:47.917207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:47.925883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:47.927051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:47.927975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 538/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 05:33:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:47.933000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:47.960469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.034058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761d0f5-3f56-4a71-b430-f05c83264007 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.067927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.068596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.068877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.069151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.069888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:48.070217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.071614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.079636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 550/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:33:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:48.085228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.125924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.185717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737adf4-b32a-45b4-86c2-2b464e03f2d6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.219435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.220231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.220511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.220791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.230838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.233007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:48.250139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:48.251211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:48.252329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:48.252329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:48.252329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:48.252329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:48.252329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 539/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:48.258521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.349751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.360799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ebf46-f95c-443a-98b4-48da4c3dc710 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.393776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.394443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.394729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.395012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.395777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:48.396089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.397455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ab1cb-284c-433a-8510-b85c94a41174 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.409869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 551/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:48.415355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.457026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d784-efba-491f-ac17-89b2d8d36824 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.457238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d784-efba-491f-ac17-89b2d8d36824 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.457517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d784-efba-491f-ac17-89b2d8d36824 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.458888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 552/1091] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:33:48.463804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.464089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.464363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.481461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:48.482826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:48.506832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.518093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699e7c-1cbf-4713-8d4e-318894ac17fd None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.552307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 553/1092] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:33:48.553247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.554032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.554310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.554581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.561923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.563384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.575545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:33:48.578147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:48.579361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:48.580672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 540/1093] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:48.584854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.659773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.678613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce4c4-053f-4587-87ed-50bcd756c59d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.683835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414ff1b-eb2f-4283-850a-d66e6adb025c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.713487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.714222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.714507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.714827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.717849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.718518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.718803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.719081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.719951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:48.720265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.721697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.725606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:33:48.733825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:48.734954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:33:48.735874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 554/1094] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:48.740826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 541/1095] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:48.740958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.746323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.762600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.841203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df6c2-f0e8-4660-99aa-462dfd6b2d6e None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.852758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75ad9-6f5a-4525-8766-651a2c318bc6 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:48.876856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.877522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.877803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.878080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.878818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:48.879147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.880523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.886628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:48.887306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:48.887594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:48.887871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:48.889301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 555/1096] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:48.895052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:48.897648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.957083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:48.958549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:48.968344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:48.998265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e85e-cd34-42ab-878b-ad3a5920c896 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.034306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.035202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.035487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.035767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] PATH_INFO: `/v3/users/28950f803ef24ac292139b32a3317d24` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.036963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] RBAC: Authorizing `identity:get_user(user_id=28950f803ef24ac292139b32a3317d24)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.038395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.040094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 556/1097] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/users/28950f803ef24ac292139b32a3317d24 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:49.045714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.067347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 542/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:33:49.068397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.113084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.146231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677e523-bfb4-4365-b0ce-54554a71f50f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.165770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749fa7-79cd-4ddb-ad24-07d286d53e41 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.175357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.182607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.183286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.183570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.183846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.200413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.201792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.202061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.202330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.212152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.213628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:33:49.230960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:49.231931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:49.233989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:33:49.233989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:33:49.233989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:33:49.233989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:49.233989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 543/1099] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:33:49.238235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.254738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.256202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.321225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.339347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8db5-7cb5-4888-b380-30e96e8337e0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.354299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 557/1100] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:33:49.360509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.374866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.375584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.375867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.376146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.376869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:49.377179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.378666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.390357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 544/1101] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:49.395879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.416405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.458590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b28b5-2178-4247-a435-2efefb103072 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.492323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.493123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.493406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.493682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.493785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab9e-542a-4717-99b0-3f1fc5e84c54 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.494860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.496353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.498676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 558/1102] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:49.504721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.526985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.527799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.528082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.528353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.535003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.536475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.543471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:33:49.551059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:33:49.552001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:33:49.552942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 545/1103] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:33:49.557895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.609568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8049dc6-d82e-4929-9df8-fd0e24497edd None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.638040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.642772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.643678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.643808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.643989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.644845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=0dce0f97ffb940ffa52bef1375645c39, user.id=28950f803ef24ac292139b32a3317d24) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:49.645155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.646572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.652592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 559/1104] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/role_assignments?user.id=28950f803ef24ac292139b32a3317d24&scope.project.id=0dce0f97ffb940ffa52bef1375645c39&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:49.659406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0284c8-bae9-4452-b6c8-bc1b25d912c7 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.697310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.697998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.698267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.698546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.699400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:49.699713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.701441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36e25f-bf45-4863-a331-376da4a5a4ab None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.714487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 546/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:33:49.721455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:49.827672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066e21-bc91-4e65-befd-be5ef5c82c4d None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:49.829242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:49.862800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:49.863497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:49.863780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:49.864057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:49.864884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] RBAC: Adding query filter params (role.id=9b1f23ffdb77452281a6ddc993884536, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=e82ecd4a337d4c088cf4a45d8c49534a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:49.865195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:49.866620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5747d-92dc-486a-b4d6-a1bdab539a91 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:49.873170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 560/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:49 2022] GET /identity/v3/role_assignments?user.id=e82ecd4a337d4c088cf4a45d8c49534a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=9b1f23ffdb77452281a6ddc993884536 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:51.736748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab689-c0f1-4fe7-b585-d48e6f069903 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:51.737262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab689-c0f1-4fe7-b585-d48e6f069903 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:51.737262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab689-c0f1-4fe7-b585-d48e6f069903 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:51.738599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 547/1107] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:51.743744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:51.744121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:51.744302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:51.761273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:51.762461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:51.828738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 561/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:51.853918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab689-c0f1-4fe7-b585-d48e6f069903 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:51.953838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab689-c0f1-4fe7-b585-d48e6f069903 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:51.987183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:51.987916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:51.988197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:51.988473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:51.989644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:51.991074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff94e2-0aec-454d-8b79-220bbce0a5e9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:51.992710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 548/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:51.998523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:52.090153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:52.096710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aeb22-f164-4031-b662-d844532ff6b1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:52.130002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:52.130663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:52.130943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:52.131251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:52.131965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:52.133378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c4d00-b72c-4715-95ac-e4c16354c315 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:52.152870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 562/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:33:51 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:33:54.258274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100b2e-b8e7-49a3-b582-8fc95dde8cc2 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:54.258875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100b2e-b8e7-49a3-b582-8fc95dde8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:54.258875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2100b2e-b8e7-49a3-b582-8fc95dde8cc2 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:54.260265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 549/1111] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:54.265986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:54.266443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:54.266550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:54.283020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:54.284243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:54.349451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 563/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:54.373862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100b2e-b8e7-49a3-b582-8fc95dde8cc2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:54.385046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:54.473741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2100b2e-b8e7-49a3-b582-8fc95dde8cc2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:54.507396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:54.508243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:54.508573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:54.508800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] PATH_INFO: `/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:54.510259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] RBAC: Authorizing `identity:get_role(role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:54.511670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:54.513037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 550/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:54 2022] GET /identity/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:54.518785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:54.599343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:54.618399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eba5f-c283-4862-96bf-cea0e275c5c5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:54.651617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:54.652486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:54.652772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:54.653052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] PATH_INFO: `/v3/users/510a9044fc714b869524a98bcc55f4ac` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:54.666070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] RBAC: Authorizing `identity:get_user(user_id=510a9044fc714b869524a98bcc55f4ac)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:54.667560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:54.669244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 564/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:54 2022] GET /identity/v3/users/510a9044fc714b869524a98bcc55f4ac => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:54.675683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:54.750039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:54.772434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb8b6-e646-461c-b4c8-a61ef8e45100 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:54.805583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:54.806220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:54.806502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:54.806777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:54.872037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:54.873569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:54.944454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:54.968488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 551/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:33:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:33:54.974364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:55.074508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd303ba7-03c8-44c0-a0d8-85616364e158 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:55.108449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:55.109309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:55.109592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:55.109867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:55.111039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:55.112500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151da60d-d6de-4d96-afcc-6d9caea7ce08 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:55.114210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 565/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:33:54 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:55.120248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:55.215932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac988f-2e2f-4403-82d2-9322a12b6c70 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:55.249346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:55.249978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:55.250263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:55.250543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:55.251396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=0dce0f97ffb940ffa52bef1375645c39, user.id=510a9044fc714b869524a98bcc55f4ac) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:33:55.251710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:55.253134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd219902-0f5a-4d36-b22f-b15ddc729e18 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:55.258441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 552/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:33:55 2022] GET /identity/v3/role_assignments?user.id=510a9044fc714b869524a98bcc55f4ac&scope.project.id=0dce0f97ffb940ffa52bef1375645c39&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:57.243042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3d14f-e3b9-4f13-a232-50698005e2b0 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.243611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3d14f-e3b9-4f13-a232-50698005e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.243611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3d14f-e3b9-4f13-a232-50698005e2b0 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.245036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 566/1118] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:57.250795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.251199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.251382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.268258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:57.269439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:33:57.303522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:57.335851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 553/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:33:57.359831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3d14f-e3b9-4f13-a232-50698005e2b0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:57.370541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:57.457995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3d14f-e3b9-4f13-a232-50698005e2b0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:57.490583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:57.491448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.491724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.491993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] PATH_INFO: `/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.493607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] RBAC: Authorizing `identity:get_role(role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:57.494939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:57.496383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 567/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:57 2022] GET /identity/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:57.502694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:57.598632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41aa95-0a06-4c16-8749-a903ec0e4eeb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:57.631001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:57.631887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.632171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.632449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] PATH_INFO: `/v3/users/510a9044fc714b869524a98bcc55f4ac` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.633621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] RBAC: Authorizing `identity:get_user(user_id=510a9044fc714b869524a98bcc55f4ac)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:57.635054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:57.636697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 554/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:33:57 2022] GET /identity/v3/users/510a9044fc714b869524a98bcc55f4ac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:57.642786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:57.718135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:57.740654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce50c16-2176-4584-b869-7a9ba7bbd4d9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:57.778732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:57.780248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.780522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.780796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.781958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:57.783402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ab43-0b11-48c2-b572-69f545008a5e None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:57.785095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 568/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:33:57 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:33:57.791212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:33:57.829718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:33:57.888118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623be54-6e59-4733-b7c7-9e1b07f399cb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:33:57.920943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:33:57.921827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:57.922104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:57.922375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39/users/510a9044fc714b869524a98bcc55f4ac/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:57.924543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dce0f97ffb940ffa52bef1375645c39, user_id=510a9044fc714b869524a98bcc55f4ac, role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:33:57.925958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b88ece-089b-4ec5-acbd-c3f9fcf391f6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:33:57.939001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 555/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:33:57 2022] PUT /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39/users/510a9044fc714b869524a98bcc55f4ac/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:33:59.925069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeadc2-cb3e-44ce-b192-d5d2d2732c3b None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:59.925615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeadc2-cb3e-44ce-b192-d5d2d2732c3b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:59.925615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daeadc2-cb3e-44ce-b192-d5d2d2732c3b None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:59.927021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 569/1124] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:33:59.932415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:33:59.932803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:33:59.932960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:33:59.950122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:33:59.951324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:00.015473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 556/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:33:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:00.038211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeadc2-cb3e-44ce-b192-d5d2d2732c3b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:00.138759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daeadc2-cb3e-44ce-b192-d5d2d2732c3b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:00.172375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:00.173214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:00.173493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:00.173765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] PATH_INFO: `/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:00.175277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] RBAC: Authorizing `identity:get_role(role_id=dd03f2fee03a4af5b5062c1b9e6d2c19)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:00.176584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:00.177936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 570/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:00 2022] GET /identity/v3/roles/dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:00.183650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:00.210211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:00.280858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3872087-9371-4eef-ac9d-2e09a95d14d6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:00.313692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:00.314564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:00.314853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:00.315161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] PATH_INFO: `/v3/users/510a9044fc714b869524a98bcc55f4ac` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:00.316350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] RBAC: Authorizing `identity:get_user(user_id=510a9044fc714b869524a98bcc55f4ac)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:00.317784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:00.319458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 557/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:00 2022] GET /identity/v3/users/510a9044fc714b869524a98bcc55f4ac => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:00.325051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:00.340149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:00.425234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6456-ea50-4e00-b22b-6e3ec255639b None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:00.458336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:00.458914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:00.459226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:00.459503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:00.525028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:00.526465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:00.539999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:00.623928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 571/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:00.629751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:00.721270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:00.727626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944b53-0aae-4c0a-94bd-44ad89b70e2a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:00.760071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:00.760907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:00.761186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:00.761457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] PATH_INFO: `/v3/projects/0dce0f97ffb940ffa52bef1375645c39` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:00.762617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=0dce0f97ffb940ffa52bef1375645c39)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:00.764700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2c28-3f5d-40c1-949f-9434afb07cc6 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:00.766372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 558/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:00 2022] GET /identity/v3/projects/0dce0f97ffb940ffa52bef1375645c39 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:00.772408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:00.869872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e3ee-ee78-4336-98c2-f9bb19d7e1df None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:00.883379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:00.905255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:00.905908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:00.906190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:00.906468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:00.907318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] RBAC: Adding query filter params (role.id=dd03f2fee03a4af5b5062c1b9e6d2c19, scope.project.id=0dce0f97ffb940ffa52bef1375645c39, user.id=510a9044fc714b869524a98bcc55f4ac) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:00.907634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:00.909069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4f780-2178-4630-a79f-d7826e3b40ed None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:00.914806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 572/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:34:00 2022] GET /identity/v3/role_assignments?user.id=510a9044fc714b869524a98bcc55f4ac&scope.project.id=0dce0f97ffb940ffa52bef1375645c39&role.id=dd03f2fee03a4af5b5062c1b9e6d2c19 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:02.978308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505062d-5aa1-4e1f-93ea-42fd7aef01c4 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:02.978859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505062d-5aa1-4e1f-93ea-42fd7aef01c4 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:02.978859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505062d-5aa1-4e1f-93ea-42fd7aef01c4 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:02.980284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 559/1131] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:02.986584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:02.986961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:02.987151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:03.004591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:03.005762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:03.072343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 573/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:03.096110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505062d-5aa1-4e1f-93ea-42fd7aef01c4 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:03.193329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505062d-5aa1-4e1f-93ea-42fd7aef01c4 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:03.226515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:03.227319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:03.227603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:03.227878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:03.229084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:03.230463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f614347-e50e-4044-84b8-9d98ab1a01fe None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:03.232677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 560/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:34:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:03.238422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:03.332773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfba72-f09a-4d84-9b08-68e6add636e8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:03.340092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:03.367719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:03.368375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:03.368653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:03.368922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:03.369625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:03.371045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64006d3f-3f8a-401f-be5b-a29a45f506d4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:03.395005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 574/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:34:03 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:34:05.436783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ac3e-a804-4cc1-a69b-edb288d1484f None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:05.437344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ac3e-a804-4cc1-a69b-edb288d1484f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:05.437344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ac3e-a804-4cc1-a69b-edb288d1484f None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:05.438723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 561/1135] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:05.443937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:05.444354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:05.444502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:05.461647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:05.462839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:05.528841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 575/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:05.552887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32ac3e-a804-4cc1-a69b-edb288d1484f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:05.583886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:05.652968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32ac3e-a804-4cc1-a69b-edb288d1484f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:05.685502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:05.686283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:05.686562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:05.686834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:05.688030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:05.689455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e35944-8f72-4383-abbf-1cb860062353 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:05.691057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 562/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:05.696763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:05.782610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:05.795369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520ee9-cb75-484c-90e2-bc7a65ea20d2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:05.828577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:05.829239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:05.829522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:05.829797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:05.830490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:05.831932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca806-7869-4efb-be8c-62b94bc17741 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:05.851522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 576/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:34:05 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:34:07.902533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa3f4-4641-4038-9f29-0db0a2220c0b None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:07.903095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa3f4-4641-4038-9f29-0db0a2220c0b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:07.903095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa3f4-4641-4038-9f29-0db0a2220c0b None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:07.904566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 563/1139] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:07.909755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:07.910159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:07.910310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:07.927700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:07.928908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:07.994843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 577/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:34:08.018524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa3f4-4641-4038-9f29-0db0a2220c0b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.112429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:08.116454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa3f4-4641-4038-9f29-0db0a2220c0b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:08.149063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:08.149847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:08.150127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:08.150399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:08.160262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:08.167859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:08.169540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:08.170790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 564/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:08.175661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.248239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:08.273570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0969b-f893-466e-aeab-ab5470b836e6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:08.306474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:08.307153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:08.307449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:08.307724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:08.308460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:08.308764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:08.310784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:08.318770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 578/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:08.324471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.422812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185f3f-6c37-45a8-a5f6-934f745e8b17 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:08.454490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:08.455384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:08.455665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:08.455939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] PATH_INFO: `/v3/users/d68e1265c8b546bb8862593d7731e83a` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:08.469042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] RBAC: Authorizing `identity:get_user(user_id=d68e1265c8b546bb8862593d7731e83a)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:08.470477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:08.472145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 565/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/users/d68e1265c8b546bb8862593d7731e83a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:08.478178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.577841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c14aa-5ae7-4702-97a9-e6c015bb95c2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:08.611473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:08.612119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:08.612405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:08.612686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:08.616330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:08.680520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:08.681896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:08.777525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 579/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:08.784932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.803997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:08.882762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2443634-416b-4750-ba40-dd0e30a1b074 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:08.915288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:08.916142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:08.916425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:08.916703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] PATH_INFO: `/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:08.917873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2ac9f6211d4669965dfaf7fe17e17e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:08.919851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ff4c-c1d2-4ca8-ae4a-063c741a0dc7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:08.921571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 566/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:08.927681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:08.961448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:09.026324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0285-786b-439c-a56d-1440b0731b7a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:09.059280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:09.060552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:09.060917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:09.061199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:09.062022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=4e2ac9f6211d4669965dfaf7fe17e17e, user.id=d68e1265c8b546bb8862593d7731e83a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:09.062336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:09.063807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb138-de4a-49a2-a25d-882cdb6130a8 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:09.069110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 580/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:34:08 2022] GET /identity/v3/role_assignments?user.id=d68e1265c8b546bb8862593d7731e83a&scope.project.id=4e2ac9f6211d4669965dfaf7fe17e17e&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:11.039295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4c32-f7ba-4733-9a52-5b0b8c522c7a None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.039845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4c32-f7ba-4733-9a52-5b0b8c522c7a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.039845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4c32-f7ba-4733-9a52-5b0b8c522c7a None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.041202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 567/1147] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:11.047033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.047485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.047629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.064570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:11.065758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:11.131036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 581/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:11.153126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4c32-f7ba-4733-9a52-5b0b8c522c7a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:11.242064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:11.257768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4c32-f7ba-4733-9a52-5b0b8c522c7a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:11.289767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:11.290489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.290768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.291038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.301332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:11.308874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:11.310593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:11.311649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 568/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:11.316675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:11.346998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:11.415601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f22e8-ee85-4d77-ae53-7bd5c52bc0fc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:11.448962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:11.449621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.449905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.450227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.450964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:11.451303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:11.452659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:11.460622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 582/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:11.466929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:11.562639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6948aa-c47e-470e-8ec2-6b14f7dc1d79 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:11.594485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:11.595362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.595643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.595914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] PATH_INFO: `/v3/users/d68e1265c8b546bb8862593d7731e83a` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.597068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] RBAC: Authorizing `identity:get_user(user_id=d68e1265c8b546bb8862593d7731e83a)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:11.598486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:11.600113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 569/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:11 2022] GET /identity/v3/users/d68e1265c8b546bb8862593d7731e83a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:11.606049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:11.695481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:11.705369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe262a02-8020-4414-a9c0-2452bfe56de0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:11.738354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:11.739226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.739510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.739785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] PATH_INFO: `/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.740953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] RBAC: Authorizing `identity:get_project(project_id=4e2ac9f6211d4669965dfaf7fe17e17e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:11.742380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047537f9-9744-4acc-8cec-5793198ceddd None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:11.744105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 583/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:11 2022] GET /identity/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:11.750134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:11.766526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:11.857041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3ef5-ef9b-4d8b-8741-213d3c22a846 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:11.889857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:11.890734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:11.891010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:11.891280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] PATH_INFO: `/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e/users/d68e1265c8b546bb8862593d7731e83a/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:11.893210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] RBAC: Authorizing `identity:create_grant(project_id=4e2ac9f6211d4669965dfaf7fe17e17e, user_id=d68e1265c8b546bb8862593d7731e83a, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:11.894618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9ce9f-075c-480c-8614-de47d8d03dfb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:11.908244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 570/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:34:11 2022] PUT /identity/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e/users/d68e1265c8b546bb8862593d7731e83a/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:34:13.889830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f44-6d1c-45a7-8807-e31dadc589ff None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:13.890384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f44-6d1c-45a7-8807-e31dadc589ff None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:13.890384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23f44-6d1c-45a7-8807-e31dadc589ff None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:13.891802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 584/1154] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:13.896863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:13.897275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:13.897413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:13.913765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:13.914952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:13.980373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 571/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:14.004551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23f44-6d1c-45a7-8807-e31dadc589ff None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.104294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23f44-6d1c-45a7-8807-e31dadc589ff None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:14.137981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:14.138765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:14.139049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:14.139356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:14.149389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:14.157034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:14.158099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:34:14.159077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 585/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:14.164096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.167121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:14.260831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c3898-5695-4d9a-826b-dd9a2f8a0b4c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:14.293181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:14.294372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:14.294912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:14.295083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:14.295860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:14.296168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:14.297546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:14.305369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 572/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:14.311601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.333141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:14.410634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b456-a2cc-4800-9000-4188b0191eb0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:14.443735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:14.444591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:14.444868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:14.445139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] PATH_INFO: `/v3/users/d68e1265c8b546bb8862593d7731e83a` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:14.446303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] RBAC: Authorizing `identity:get_user(user_id=d68e1265c8b546bb8862593d7731e83a)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:14.447756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:14.449391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 586/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/users/d68e1265c8b546bb8862593d7731e83a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:14.455167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.518832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:14.553356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3d3bd-497e-4856-940c-532a21074151 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:14.585044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:14.585673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:14.585955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:14.586230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:14.651732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:14.653674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:14.714915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:14.751028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 573/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:14.756944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.843467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:14.856223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0506-cf08-4313-b3e5-e28ef7f641f7 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:14.890234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:14.891083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:14.891398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:14.891674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] PATH_INFO: `/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:14.892825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e2ac9f6211d4669965dfaf7fe17e17e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:14.894235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821f2d-b2c5-4fc5-8668-e15525da55b3 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:14.895960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 587/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/projects/4e2ac9f6211d4669965dfaf7fe17e17e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:14.902036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:14.996406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6bc2b-ff26-454b-b4bc-cb8dc8707f57 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:15.029306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:15.029955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:15.030229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:15.030501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:15.031586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=4e2ac9f6211d4669965dfaf7fe17e17e, user.id=d68e1265c8b546bb8862593d7731e83a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:15.031892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:15.033313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9f29-758c-4f31-8da9-4fd9b03a127e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:15.039018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 574/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:34:14 2022] GET /identity/v3/role_assignments?user.id=d68e1265c8b546bb8862593d7731e83a&scope.project.id=4e2ac9f6211d4669965dfaf7fe17e17e&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:17.080510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b008-409e-4ecf-b641-e4656c22fa4c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:17.081034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b008-409e-4ecf-b641-e4656c22fa4c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:17.081034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b008-409e-4ecf-b641-e4656c22fa4c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:17.082443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 588/1162] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:17.087622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:17.088010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:17.088187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:17.105464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:17.106823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:17.129391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:17.172391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 575/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:17.194481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7b008-409e-4ecf-b641-e4656c22fa4c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:17.293453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7b008-409e-4ecf-b641-e4656c22fa4c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:17.326089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:17.326725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:17.327008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:17.327316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:17.352179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:17.395088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:17.396554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:17.489958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 589/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:17.496090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:17.592013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd514-f21c-4db0-a102-569bfd0d6323 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:17.625035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:17.625775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:17.626055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:17.626327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:17.632839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:17.634272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-39a71624-6add-46f5-b9d8-5a89f2804669 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:17.648659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:17.649818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:17.650848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 576/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:34:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:17.655973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:17.710501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:17.753010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522ebd7-1f1b-44e7-ad85-f8119193601f None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:17.785418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:17.786064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:17.786345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:17.786633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:17.787350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:17.787660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:17.789001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a030be-7579-4d8f-a7fc-8b6e32ff659c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:17.796903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 590/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 05:34:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:19.788909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242cebc-d78c-4821-bd42-38d41130a1b4 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:19.789425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242cebc-d78c-4821-bd42-38d41130a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:19.789425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242cebc-d78c-4821-bd42-38d41130a1b4 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:19.790767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 577/1167] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:19.796624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f5d-d6ee-4b9d-a1bb-0b73770c602a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:19.797019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f5d-d6ee-4b9d-a1bb-0b73770c602a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:19.797182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f5d-d6ee-4b9d-a1bb-0b73770c602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:19.813993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0e795f5d-d6ee-4b9d-a1bb-0b73770c602a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:19.815226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0e795f5d-d6ee-4b9d-a1bb-0b73770c602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:19.881996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 591/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:19.904975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242cebc-d78c-4821-bd42-38d41130a1b4 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:19.927091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:20.005482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242cebc-d78c-4821-bd42-38d41130a1b4 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:20.040089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:20.040681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:20.040968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:20.041246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:20.041986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:20.043376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad90f20-f59d-439c-8162-198f36e29485 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:20.057594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 578/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Jul 25 05:34:19 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:34:22.152672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558492d-e8c7-4078-9c16-13d0327c0d67 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:22.153797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558492d-e8c7-4078-9c16-13d0327c0d67 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:22.153797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558492d-e8c7-4078-9c16-13d0327c0d67 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:22.155097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 592/1170] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:22.160346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:22.160753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:22.160903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:22.177972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:22.179180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:22.244564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 579/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:34:22.267789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558492d-e8c7-4078-9c16-13d0327c0d67 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:22.316953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:22.367818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558492d-e8c7-4078-9c16-13d0327c0d67 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:22.400920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:22.401778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:22.402059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:22.402338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] PATH_INFO: `/v3/domains/61cb0ff8914e4ed3a85117b3d98b2346` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:22.413388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=61cb0ff8914e4ed3a85117b3d98b2346)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:22.414762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f753f0c-a300-490f-bd5a-16c007be25f0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:22.416451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 593/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 25 05:34:22 2022] GET /identity/v3/domains/61cb0ff8914e4ed3a85117b3d98b2346 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:22.422429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:22.433714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:22.520441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5c43-09e9-43f2-a03f-e67d1eadd7ed None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:22.553166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:22.553812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:22.554092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:22.554368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:22.555081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:22.556529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace9572-6466-44e4-8320-dd951407c2d7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:22.580522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 580/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:34:22 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:34:24.632390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031dcf-4923-4c55-8c4d-aadd9f40fba3 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:24.632934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031dcf-4923-4c55-8c4d-aadd9f40fba3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:24.632934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031dcf-4923-4c55-8c4d-aadd9f40fba3 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:24.634249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 594/1174] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:24.639433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:24.639821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:24.639987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:24.656439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:24.657629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:24.713786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:24.724883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 581/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:24.749804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a031dcf-4923-4c55-8c4d-aadd9f40fba3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:24.853522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a031dcf-4923-4c55-8c4d-aadd9f40fba3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:24.865026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:24.888278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:24.889080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:24.889359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:24.889632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] PATH_INFO: `/v3/domains/61cb0ff8914e4ed3a85117b3d98b2346` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:24.890807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=61cb0ff8914e4ed3a85117b3d98b2346)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:24.892275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0646b6a-ea0a-4f83-a35f-9008eb3299ea None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:24.893913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 595/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 25 05:34:24 2022] GET /identity/v3/domains/61cb0ff8914e4ed3a85117b3d98b2346 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:24.899690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:24.994071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a954e8d-6924-447d-9a34-d0bce906ff20 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:25.025559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:25.026215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:25.026545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:25.026824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:25.027549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:25.029668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437f931-71a8-42b9-968b-e9aa6da62ec7 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:25.049009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 582/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:34:24 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:34:27.116262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46b6e-8e38-4d4f-9166-94cb867b3e5f None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.116823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46b6e-8e38-4d4f-9166-94cb867b3e5f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.116823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d46b6e-8e38-4d4f-9166-94cb867b3e5f None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.118242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 596/1178] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:27.123474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.123935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.124036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.140257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:27.141432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:27.183640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:27.206657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 583/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:34:27.230286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46b6e-8e38-4d4f-9166-94cb867b3e5f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:27.329755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d46b6e-8e38-4d4f-9166-94cb867b3e5f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:27.364257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:27.365049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.365334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.365614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.375656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:27.383277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:27.384455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:34:27.385407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 597/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:27.390620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:27.486986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235d3e-a1c2-40b6-b453-70c97c3f57b5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:27.519434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:27.520088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.520400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.520679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.521417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:27.521723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:27.523116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:27.531574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 584/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:27.537291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:27.576523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:27.635623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafafb32-6296-4372-84ff-3344e1db0372 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:27.669288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:27.670145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.670424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.670697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] PATH_INFO: `/v3/users/21756f1595434595a6ad58f0fef0a010` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.683300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] RBAC: Authorizing `identity:get_user(user_id=21756f1595434595a6ad58f0fef0a010)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:27.685064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:27.686700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 598/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:27 2022] GET /identity/v3/users/21756f1595434595a6ad58f0fef0a010 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:27.692363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:27.734386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:27.791508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d53f-04c6-410b-a638-b0e200577e28 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:27.825672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:27.826299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:27.826582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:27.826864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:27.892872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:27.894259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:27.932148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:27.989527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 585/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:27.995365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:28.090013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:28.095917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292556-ff1b-4ccb-800f-873e35091d7a None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:28.128909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:28.129760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:28.130039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:28.130313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] PATH_INFO: `/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:28.131504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] RBAC: Authorizing `identity:get_project(project_id=8d6956bc213e4acd9a3a8e3d7afed7b2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:28.132918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760123f-5de5-4b3b-95eb-a117f9b80680 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:28.134614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 599/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:27 2022] GET /identity/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:28.141426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:28.236856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12218-8720-462a-9918-af3489d4f12c None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:28.269431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:28.270069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:28.270353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:28.270631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:28.271483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=8d6956bc213e4acd9a3a8e3d7afed7b2, user.id=21756f1595434595a6ad58f0fef0a010) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:28.271797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:28.273223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d092bf9-edac-425b-8960-4c25e2a59e63 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:28.278599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 586/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:34:28 2022] GET /identity/v3/role_assignments?user.id=21756f1595434595a6ad58f0fef0a010&scope.project.id=8d6956bc213e4acd9a3a8e3d7afed7b2&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:30.263997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09494e-b7ee-46de-9e16-e1ab9da36ef9 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.264553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09494e-b7ee-46de-9e16-e1ab9da36ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.264553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09494e-b7ee-46de-9e16-e1ab9da36ef9 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.265916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 600/1186] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:30.271179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.271586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.271735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.277652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:30.288890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:30.290079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:30.355815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 587/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:30.378754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09494e-b7ee-46de-9e16-e1ab9da36ef9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:30.478392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09494e-b7ee-46de-9e16-e1ab9da36ef9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:30.512117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:30.512930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.513213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.513491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.523436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:30.530934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:30.532055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:34:30.533112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 601/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:30.538087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:30.634335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243e92-8a95-4840-a9a1-dab5a36ae5bc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:30.666499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:30.667174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.667464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.667741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.669038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:30.669391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:30.670755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:30.672118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:30.679753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 588/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:30.686092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:30.710894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:30.782881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a4a8-425a-43b7-bf7e-82561ec7a6bc None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:30.815855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:30.816706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.816984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.817253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] PATH_INFO: `/v3/users/21756f1595434595a6ad58f0fef0a010` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.818405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=21756f1595434595a6ad58f0fef0a010)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:30.819849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:30.821472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 602/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:30 2022] GET /identity/v3/users/21756f1595434595a6ad58f0fef0a010 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:30.827504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:30.924956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780f116-441f-4a61-9010-c52be6938c7f None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:30.958257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:30.959114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:30.959429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:30.959707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] PATH_INFO: `/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:30.960881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] RBAC: Authorizing `identity:get_project(project_id=8d6956bc213e4acd9a3a8e3d7afed7b2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:30.962313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20a330-b4b6-4889-a613-e3f1c772dd77 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:30.964057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 589/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:30 2022] GET /identity/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:30.969958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:31.058180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:31.067473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba7de-4425-4288-b8e7-26f3545cd4d2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:31.099710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:31.100584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:31.100863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:31.101398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] PATH_INFO: `/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2/users/21756f1595434595a6ad58f0fef0a010/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:31.103336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=8d6956bc213e4acd9a3a8e3d7afed7b2, user_id=21756f1595434595a6ad58f0fef0a010, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:31.104751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2519c1-4da5-4e48-92d9-4550555e7bfa None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:31.117156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 603/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:34:30 2022] PUT /identity/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2/users/21756f1595434595a6ad58f0fef0a010/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:34:33.102204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb68a-4547-4f73-b87b-c279f8212325 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.102735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb68a-4547-4f73-b87b-c279f8212325 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.102735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb68a-4547-4f73-b87b-c279f8212325 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.104147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 590/1193] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:34:33.110227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.110615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.110786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.127415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:34:33.128581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:34:33.192674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 604/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:34:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:34:33.216290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acb68a-4547-4f73-b87b-c279f8212325 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:33.277543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:33.316572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acb68a-4547-4f73-b87b-c279f8212325 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:33.349204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:33.349984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.350262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.350535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.361767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:34:33.369105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:34:33.370196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:34:33.371263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 591/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:34:33.376371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:33.455544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:33.474369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9374917-ff86-4f07-980a-f63837c25c38 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:33.506734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:33.507411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.507689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.507961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.508691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:33.508996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:33.510345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:33.518936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 605/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:33.524661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:33.621736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ca90-b148-416d-bfa5-f37aa48a0afe None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:33.644647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:33.655414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:33.656277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.656557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.656832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] PATH_INFO: `/v3/users/21756f1595434595a6ad58f0fef0a010` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.658004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] RBAC: Authorizing `identity:get_user(user_id=21756f1595434595a6ad58f0fef0a010)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:33.659458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:33.661087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 592/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 05:34:33 2022] GET /identity/v3/users/21756f1595434595a6ad58f0fef0a010 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:33.666765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:33.765856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf26e1c-5901-48e1-8417-e800ed304410 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:33.798432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:33.799066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:33.799456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:33.799736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:33.814075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:33.867073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:33.868561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:33.963022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 606/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:34:33.969410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:34.067952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1ffe-210b-4e76-94f4-4f22dad85973 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:34.100653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:34.101751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:34.102027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:34.102296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] PATH_INFO: `/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:34.103545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] RBAC: Authorizing `identity:get_project(project_id=8d6956bc213e4acd9a3a8e3d7afed7b2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:34.105010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2c278-275a-4392-91b9-9f582c42bc40 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:34.107349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 593/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 05:34:33 2022] GET /identity/v3/projects/8d6956bc213e4acd9a3a8e3d7afed7b2 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:34.113506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:34:34.157586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:34.209663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a21d-7938-4c68-882b-571cbda8a865 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:34:34.242878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:34:34.243487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:34:34.243769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:34:34.244045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:34:34.244859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=8d6956bc213e4acd9a3a8e3d7afed7b2, user.id=21756f1595434595a6ad58f0fef0a010) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:34:34.245167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:34:34.246702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6819-95d8-42bc-8e0d-97063051f115 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:34:34.252491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 607/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:34:34 2022] GET /identity/v3/role_assignments?user.id=21756f1595434595a6ad58f0fef0a010&scope.project.id=8d6956bc213e4acd9a3a8e3d7afed7b2&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:34:44.096645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=70 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:34:44.249884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=46 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:29.239480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf466ba-1380-456b-87f6-eaa5e6fc6562 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:29.240072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf466ba-1380-456b-87f6-eaa5e6fc6562 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:29.240072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf466ba-1380-456b-87f6-eaa5e6fc6562 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:29.241392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 594/1201] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:29.246964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:29.248057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:29.248575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:29.266799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:29.268018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:29.358796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 608/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:29.383021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf466ba-1380-456b-87f6-eaa5e6fc6562 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:29.506176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf466ba-1380-456b-87f6-eaa5e6fc6562 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:29.550959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:29.551981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:29.552297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:29.552601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:29.564591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:29.566052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:29.585233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:29.586318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:29.587806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:29.587806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:29.587806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:29.587806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:29.592024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 595/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:29.593112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:29.723036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e86a-0617-4503-b2d4-dab96ce0ffdb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:29.760866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:29.769136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:29.770393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:29.771003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:29.771562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:29.772559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:29.772939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:29.774424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491140f-ff42-497c-b366-cae39825cd53 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:29.795455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 609/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:29.796833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:29.858458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:29.933711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43984-8ecf-4ea8-abcc-b4228ab32bca None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:29.977373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:29.978157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:29.978427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:29.978767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:29.979497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:29.981712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85f0b4-b163-4ef3-a33e-0caaf4b056d4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:30.015249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 596/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 05:35:29 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:35:32.393327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb4dc-5ac4-433e-af8b-de7c672d7b48 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:32.393887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb4dc-5ac4-433e-af8b-de7c672d7b48 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:32.393985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feb4dc-5ac4-433e-af8b-de7c672d7b48 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:32.395509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 610/1206] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:32.401485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:32.401937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:32.402128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:32.425673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:32.426990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:32.505119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 597/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:32.530518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb4dc-5ac4-433e-af8b-de7c672d7b48 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:32.657644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feb4dc-5ac4-433e-af8b-de7c672d7b48 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:32.696671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:32.697515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:32.697808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:32.698083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:32.710491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:32.718762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:32.719854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:32.720721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 611/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:32.729939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:32.774711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:32.848309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91084c45-7b94-431d-ab67-77bb2f41fa78 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:32.889485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:32.890282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:32.890625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:32.890965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:32.891748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:32.892057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:32.893572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:32.901919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 598/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:32.908474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:32.967710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:33.033675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0ec9-cb5e-476c-aaf0-2f73af12dedf None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:33.074115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:33.074941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:33.075254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:33.075524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:33.087155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:33.088652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:33.109137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:33.110957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:33.111920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:33.111920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:33.111920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:33.111920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:33.111920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 612/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:33.117671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:33.234156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:33.238118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8f00-312d-483e-84bd-b62cad5fb1c5 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:33.284680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:33.285436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:33.285722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:33.286043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:33.286771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:33.287152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:33.288680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:33.305312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 599/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:33.312395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:33.441247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e54db-1368-411c-894b-386e8a82f3ec None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:33.442837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:33.477370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:33.478275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:33.478499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:33.478927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:33.489040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:33.489475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:33.505536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:33.506645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:33.507677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 613/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:33.513045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:33.622593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19be5d0-ac6e-4461-867f-d7933d4088dc None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:33.666660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:33.667392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:33.667637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:33.667914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:33.669386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:33.669720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:33.671212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:33.692297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 600/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:33.697792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:33.821430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed399-2cab-4b6c-a823-e96f12c2bf32 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:33.862982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:33.863671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:33.863957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:33.864243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:33.901131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:33.947514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:33.949006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:34.070253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 614/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:35:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:34.076785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:34.097934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:34.185910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453779c-7026-46e0-a5b5-3b3b81015a60 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:34.223495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:34.224386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:34.224663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:34.225016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:34.235901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:34.237356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:34.256358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:34.257662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:34.259170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:34.259170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:34.259170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:34.259170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:34.259170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 601/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:34.265170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:34.331193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:34.374912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b2c74-e08c-4b6b-aed2-8c238cbdad34 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:34.418733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:34.419519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:34.419872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:34.420185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:34.421057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:34.421516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:34.423028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:34.436143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 615/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:34.441884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:34.532262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:34.575014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a1f03-0d2e-4cca-8be4-858bbbe5daac None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:34.615459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:34.616370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:34.616814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:34.617104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:34.626925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:34.628747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:34.645519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:34.646862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:34.648345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:34.654149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 602/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:34.654316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:34.767432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9161841-6e8e-4fbc-8d84-c1a628b698d2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:34.794506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:34.807348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:34.808023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:34.808306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:34.808606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:34.810087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:34.810399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:34.811867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59a2d7-3d94-4c80-b129-af22b7d94a4c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:34.825701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 616/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:34.832155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:34.948627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142815-09dd-48de-bbc1-c8aa8d28ab06 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:34.982426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:34.990204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:34.990937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:34.991326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:34.991766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:34.992736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=48e5ad200c9f4c00b971765eff2b194a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:34.993188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:34.994960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9fcfa-c204-4002-a626-da1155a53a32 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:35.011167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 603/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:35:34 2022] GET /identity/v3/role_assignments?user.id=48e5ad200c9f4c00b971765eff2b194a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:37.146603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a528e-02b2-4466-b781-7184874eb02f None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.147181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a528e-02b2-4466-b781-7184874eb02f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.147181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a528e-02b2-4466-b781-7184874eb02f None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.148719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 617/1220] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:37.154296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.154689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.154882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.174526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:37.175846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:37.248537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 604/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:37.274212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a528e-02b2-4466-b781-7184874eb02f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:37.402311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a528e-02b2-4466-b781-7184874eb02f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:37.438659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:37.439486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.439769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.440069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.451419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:37.459097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:37.460256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:37.461468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 618/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:37.466433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:37.580350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43c0cf-a8f6-4b24-813b-5daf5a76fdfc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:37.605130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:37.617393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:37.618147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.618351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.618617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.619395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:37.619700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:37.621665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:37.630116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 605/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:37.636083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:37.680915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:37.741478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8af68-6057-4fcd-94ea-79a0c1210320 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:37.777430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:37.778235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.778513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.778789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.789484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:37.790949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:37.812272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:37.813372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:37.814539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:37.814539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:37.814539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:37.814539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:37.814539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 619/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:37.820439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:37.938041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815b28d-7061-46c0-9b4d-8108d58c00f9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:37.973720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:37.974505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:37.974820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:37.975239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:37.976075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:37.976512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:37.978322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:37.992512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 606/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:37.999114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:38.105243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:38.116057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab279-ad65-4c3d-8111-34cd9a5d5562 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:38.160799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:38.161612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:38.161891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:38.162165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:38.169544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:38.170985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:38.186127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:38.187328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:38.189126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 620/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:38.194310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:38.248491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:38.307025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d2cca-796b-4a59-8974-ec5aa08b936e None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:38.344588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ad08-7818-4312-a947-134860210091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:38.345368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ad08-7818-4312-a947-134860210091 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:38.345729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ad08-7818-4312-a947-134860210091 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:38.346126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ad08-7818-4312-a947-134860210091 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:38.347054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ad08-7818-4312-a947-134860210091 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:38.347547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ad08-7818-4312-a947-134860210091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:38.349097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ad08-7818-4312-a947-134860210091 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:38.368820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 607/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:38.374838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:38.493940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139abf-878a-43d8-a3c9-b41e3d440178 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:38.533413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:38.534237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:38.534575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:38.534915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:38.546495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:38.548322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:38.566347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:38.567516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:38.568769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:38.568769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:38.568769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:38.568769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:38.568769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 621/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:38.573874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ad08-7818-4312-a947-134860210091 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:38.684166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ad08-7818-4312-a947-134860210091 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:38.687019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:38.721277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:38.721933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:38.722210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:38.722480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:38.723222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:38.723527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:38.725001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:38.739585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 608/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:38.745533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:38.754519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:38.848641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a52ec1-070b-4e7c-b239-827ad2ac18ae None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:38.887483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:38.888451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:38.888778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:38.889175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:38.898719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:38.900434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:38.919246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:38.920328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:38.921523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 622/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:38.927091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:39.036120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672cd9-2812-4b9e-9690-e562513c29b4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:39.080149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:39.080859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:39.081101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:39.081383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:39.082197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:39.082473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:39.083944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874c45-9ca5-4d99-86a8-eb9cb3ca7012 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:39.098033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 609/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:39.105834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:39.176562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:39.214720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964ffc2-877a-41f3-bfeb-72b9b70906f0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:39.251463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:39.252358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:39.252639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:39.252913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/48e5ad200c9f4c00b971765eff2b194a/roles/7c096f8d1d7e41afb5a5e5fbf4e11452` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:39.268675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=48e5ad200c9f4c00b971765eff2b194a, role_id=7c096f8d1d7e41afb5a5e5fbf4e11452)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:39.270116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb216bd-e7d9-4f01-9434-fa46a1589d80 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:39.283483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 623/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:35:39 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/48e5ad200c9f4c00b971765eff2b194a/roles/7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:35:41.345136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71027-1335-41be-a435-4667f8bc980c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:41.345136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71027-1335-41be-a435-4667f8bc980c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:41.345136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71027-1335-41be-a435-4667f8bc980c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:41.345136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 610/1233] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:41.351493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:41.352161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:41.352315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:41.370780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:41.372093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:41.442957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 624/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:41.468604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71027-1335-41be-a435-4667f8bc980c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:41.498660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:41.585028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71027-1335-41be-a435-4667f8bc980c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:41.623518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:41.624425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:41.624872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:41.625240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:41.635861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:41.644229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:41.645362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:41.646388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 611/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 05:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:41.654387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:41.704323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:41.763227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1959d-86b4-4eec-8a95-a399f884ae9a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:41.800320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:41.801005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:41.801286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:41.801565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:41.802301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:41.802604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:41.804003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:41.813733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 625/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 05:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:41.819917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:41.917652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:41.934800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd05ef-f462-47d1-b0f9-034af700ddaa None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:41.971938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:41.972741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:41.973016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:41.973296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:41.985398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:41.986909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:42.006381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:42.007456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:42.008634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:42.008634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:42.008634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:42.008634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:42.008634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 612/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:42.014296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:42.130650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea470-f64b-4a10-92f7-d7e73f1f28b5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:42.140074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:42.165531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:42.166188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:42.166458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:42.166726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:42.167467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:42.168348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:42.169784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:42.181893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 626/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:42.188346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:42.301548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653cc31-9e6c-4ccd-90a4-db903c550721 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:42.343614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:42.344676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:42.344956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:42.345225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:42.348238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:42.354552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:42.357688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:42.375013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:42.376094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:42.377239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 613/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:42.383458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:42.497927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feb5a0-a392-490c-9955-eb4da0ec25ca None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:42.532868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:42.533536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:42.533816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:42.534095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:42.534919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:42.535258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:42.536680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:42.554203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 627/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:42.560279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:42.665565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7049a-0efa-4d80-bba1-9ef79a74a4cf None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:42.702224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:42.702992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:42.703369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:42.703781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:42.773416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:42.782013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:42.783507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:42.896416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 614/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:35:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:42.902321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:42.935569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:43.021329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760907-930b-4e59-8119-5c80eccb0096 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:43.061126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:43.062035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:43.062444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:43.062776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:43.076500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:43.078108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:43.098096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:43.099237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:43.100164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:43.100164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:43.100164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:43.100164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:43.100164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 628/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:43.106932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:43.210938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:43.218051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b5de-e2b1-4aca-b546-4b7e403fe0b4 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:43.253477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:43.254145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:43.254453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:43.254699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:43.255457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:43.255748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:43.257105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:43.273826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 615/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:43.275079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:43.362571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:43.390365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b92-e60b-413f-bcfd-547c287b8424 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:43.429837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:43.430941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:43.430941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:43.431236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:43.438412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:43.439898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:43.453642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:43.454989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:43.456465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 629/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:43.461067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:43.576832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d719f-da87-48ef-8a57-2c82522d311b None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:43.625378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:43.626541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:43.626917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:43.627347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:43.628216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:43.628533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:43.630226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eda078-3187-4c2a-b8d3-72f31d0e02ed None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:43.646135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 616/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:43.652994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:43.780366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e9c8-247e-48a2-b959-4acb498971e5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:43.826699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:43.827529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:43.827953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:43.828406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:43.832194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] RBAC: Adding query filter params (role.id=7c096f8d1d7e41afb5a5e5fbf4e11452, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=48e5ad200c9f4c00b971765eff2b194a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:43.832194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:43.832194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09603f2c-7c24-4f6f-b186-e236b37e6878 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:43.839210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 630/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:35:43 2022] GET /identity/v3/role_assignments?user.id=48e5ad200c9f4c00b971765eff2b194a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=7c096f8d1d7e41afb5a5e5fbf4e11452 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:46.258183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4db17d-6a78-4dd0-93eb-97cd9bed2b23 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:46.258735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4db17d-6a78-4dd0-93eb-97cd9bed2b23 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:46.258735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4db17d-6a78-4dd0-93eb-97cd9bed2b23 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:46.260165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 617/1247] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:46.265583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:46.266009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:46.266141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:46.271348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:46.285203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:46.286419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:46.360005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 631/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:35:46.384969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4db17d-6a78-4dd0-93eb-97cd9bed2b23 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:46.405220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:46.501080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4db17d-6a78-4dd0-93eb-97cd9bed2b23 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:46.541229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:46.541966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:46.542250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:46.542533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:46.553213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:46.563186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:46.564196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:46.565350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 618/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:46.571242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:46.682882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba3b0c-3b86-4924-a3ba-790c958f07b5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:46.719948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:46.726510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:46.727560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:46.727845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:46.728137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:46.728927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:46.729234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:46.731233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:46.740356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 632/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:46.746921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:46.828476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:46.852695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fefb0-0584-4458-bdfa-5b7fd7b75497 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:46.888147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:46.888942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:46.889224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:46.889502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:46.900479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:46.902338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:46.921025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:46.923009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:46.925035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:46.925035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:46.925035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:46.925035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:46.925035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 619/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:46.928164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:47.047559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c069b7-da89-403a-9516-f2ba3c9f864c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:47.088736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:47.090183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:47.090600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:47.090927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:47.091995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:47.092428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:47.094232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:47.110259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 633/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:47.116648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:47.225378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74496b4-936a-4319-98b0-0311508adaaf None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:47.253361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:47.261225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:47.262100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:47.262388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:47.262662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:47.270733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:47.272220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:47.288821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:47.289844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:47.290798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 620/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:47.297864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:47.362613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:47.413875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b55b-d33e-4662-9d84-6e447032a5ac None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:47.449849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:47.450674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:47.450932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:47.451260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:47.452065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:47.452387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:47.453833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:47.470971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 634/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:47.477448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:47.590492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b232-1e8b-4ef2-bda5-a74017593db9 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:47.627071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:47.627672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:47.627958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:47.628233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:47.689526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:47.703577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:47.705093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:47.815066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 621/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:35:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:47.820897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:47.929266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09458cc6-9050-4532-a0bb-14c91bed4873 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:47.944346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:47.967018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:47.967837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:47.968114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:47.968389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:47.978870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:47.981034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:47.998841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:48.000037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:48.000964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:48.000964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:48.000964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:48.000964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:48.000964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 635/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:35:48.006326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:48.099769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:48.114855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbea06-b26b-40d5-88e2-a633349ad380 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:48.153289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:48.154096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:48.154471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:48.154840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:48.155700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:48.156152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:48.157602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:48.169351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 622/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:48.175344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:48.283409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcb8f-6626-4543-9ac8-76b2c7a414a0 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:48.319621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:48.320417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:48.320692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:48.320988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:48.328683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:48.330122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:48.344838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:48.351120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:48.353171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 636/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:48.353763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:48.465537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f85fa-bedd-4055-971e-de6e5d0b47f2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:48.503316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:48.503989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:48.504266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:48.504537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:48.505333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:48.505640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:48.507092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938aa0a-2b6b-420b-b43c-682d8c8e067a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:48.521165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 623/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:48.528165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:48.556212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:48.637643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ffd26-993c-4e41-9c60-d72c312b94f4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:48.672859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:48.673522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:48.673802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:48.674077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:48.674910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=48e5ad200c9f4c00b971765eff2b194a) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:48.675251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:48.676704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e66d6-070b-4e92-83a8-7bfb90272d22 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:48.682874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 637/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:35:48 2022] GET /identity/v3/role_assignments?user.id=48e5ad200c9f4c00b971765eff2b194a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:50.715433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7d54-83f8-4304-a4d5-d2cb8e66fbb9 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:50.715950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7d54-83f8-4304-a4d5-d2cb8e66fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:50.715950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7d54-83f8-4304-a4d5-d2cb8e66fbb9 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:50.717280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 624/1261] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:50.722441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:50.722857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:50.722998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:50.740434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:50.741620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:50.808367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 638/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:50.830528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde7d54-83f8-4304-a4d5-d2cb8e66fbb9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:50.841698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:50.930038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde7d54-83f8-4304-a4d5-d2cb8e66fbb9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:50.962368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:50.963177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:50.963467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:50.963743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:50.974131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:50.982584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:50.983716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:50.984783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 625/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:50.989683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.007372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:51.099462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b516-f1ab-471f-98ae-b466055c71d2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.137907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.138574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.138858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.139171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.139899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:51.140208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.141567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.149564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 639/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:51.156117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.219866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:51.253113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f861f-b6a3-44c9-bc0b-154c535d9824 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.286116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.286904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.287217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.287500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.297830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.299304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:51.315925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:51.316987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:51.318238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:51.318238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:51.318238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:51.318238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:51.318238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 626/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:51.323057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.404224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:51.422440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131a140-542e-40c2-be92-fa583c54f0eb None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.454932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.455619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.455902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.456176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.456886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:51.457189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.458544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.470762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 640/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:51.476496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.574747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d5ff-7e61-4c2e-8ad3-692406dc6368 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.593532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:51.607744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.608535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.608815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.609090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.616280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.617725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:51.632057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:51.633125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:51.634239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 627/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:51.639687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.737500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b7da-7120-4826-a2a2-2e71fea11ef2 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.769795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.770452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.770736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.771014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.771875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:51.772184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.773609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.782489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:51.791157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 641/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:51.797556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:51.893435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f4646-d518-469b-98ea-7cfadd465b68 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:51.925630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:51.926405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:51.926684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:51.926954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:51.937189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:51.938614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:51.955658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:51.956682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:51.962386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:51.962386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:51.962386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:51.962386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:51.962386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 628/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:51.962722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:52.063684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eaa0e-665a-4be0-ab4e-01ae21d7a430 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:52.099739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:52.100406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:52.100690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:52.100970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:52.101950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:52.102259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:52.103658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:52.114810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 642/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:35:52.120467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:52.151413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:52.217667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a1b3-334e-444d-944f-7648058275cb None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:52.249936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:52.250714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:52.251019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:52.251315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:52.257775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:52.259241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:52.273386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:52.274411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:52.275696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 629/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:52.281117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:52.338778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:52.381607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c34d0-04ef-4351-9254-b638c9e701c9 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:52.414738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:52.415368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:52.415654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:52.415932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:52.416715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:52.417025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:52.418655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1f89b-9640-43a2-b0fc-87ebe73b8854 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:52.431349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 643/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:52.437828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:52.527091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:52.535968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1e28a-1a02-4da8-b071-6117e44d1876 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:52.568896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:52.569789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:52.570059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:52.570336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] PATH_INFO: `/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/48e5ad200c9f4c00b971765eff2b194a/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:52.572301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7c8f94b507e48319424d3a1166b5e35, user_id=48e5ad200c9f4c00b971765eff2b194a, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:52.573833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b97b45-0566-40fb-b417-e91afe9f2188 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:52.586106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 630/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 05:35:52 2022] PUT /identity/v3/projects/b7c8f94b507e48319424d3a1166b5e35/users/48e5ad200c9f4c00b971765eff2b194a/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:35:54.593575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9b58-ac70-4829-a14b-3395d067f25a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:54.594090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9b58-ac70-4829-a14b-3395d067f25a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:54.594178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9b58-ac70-4829-a14b-3395d067f25a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:54.595532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 644/1274] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:54.600709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:54.601136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:54.601241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:54.618319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:54.619532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:54.683732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 631/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:54.707204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce9b58-ac70-4829-a14b-3395d067f25a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:54.808683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce9b58-ac70-4829-a14b-3395d067f25a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:54.825206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:54.842028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:54.842805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:54.843081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:54.843380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:54.853445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:35:54.861472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:54.862656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:54.863944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 645/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 05:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:54.868512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:54.946006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:54.965549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4f29f-5418-4c5a-9e95-68188f111679 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:54.998128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:54.998783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:54.999063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:54.999367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.000107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:55.000411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.001782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.009586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 632/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 05:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:55.015731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:55.115471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868774-52e2-4613-9bf6-f65f12483ced None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:55.154095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:55.154873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:55.155183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:55.155466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.166032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.167735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:55.184552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:55.185590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:55.186539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:55.186539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:55.186539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:55.186539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:55.186539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 646/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:55.191453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:55.293049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8014-c60f-4612-bb24-89443757ab29 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:55.326271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:55.326917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:55.327223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:55.327496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.328199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:55.328499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.329838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.341893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 633/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:55.347828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:55.383493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:55.452306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37c73-6bfc-4b48-b08b-966a91579d95 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:55.484594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:55.485386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:55.485661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:55.485930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.493082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.494510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:35:55.509110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:55.510089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:55.512878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 647/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:55.517278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:55.521031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:55.614477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97db0-8523-42cd-944d-17b766b8a166 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:55.650050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:55.650655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:55.650938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:55.651244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.652117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:55.652628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.654061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.671185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 634/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:55.676971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:55.767684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:55.777722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5b938-5328-46a2-bc59-2be143a735a5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:55.811532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:55.812165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:55.812447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:55.812725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:55.878546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:55.880026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:55.966103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:55.976207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 648/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:35:55.983244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:56.041432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:56.078357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be67b5-b32c-4cf3-bca3-65edcc5747f0 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:56.111913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:56.112696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:56.112975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:56.113246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:56.123311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:56.124770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:35:56.141817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:56.142928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:56.144165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:35:56.144165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:35:56.144165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:35:56.144165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:56.144165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 635/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:56.148779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:56.244666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f96bff-f168-4202-ae5d-bc4e67a022f4 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:56.277759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:56.278411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:56.278696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:56.278967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:56.279708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:56.280012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:56.281357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:56.292372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 649/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 05:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:56.298527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:56.397805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766862-31fe-488d-b4a5-414885ce0de2 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:56.411922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:56.432166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:56.433026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:56.433803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:56.434079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:56.440598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:56.442042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:35:56.455904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:56.456965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: ERROR keystone.server.flask.application Jul 25 05:35:56.458133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 636/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 05:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:56.462907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:56.512951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:56.562750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cfb07-dd26-49af-b83f-2ab3cdb0308c None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:56.595037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:56.595712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:56.595997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:56.596275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:56.597049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:56.597358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:56.598773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b5e60-fb38-4f38-90b6-cf146686ee15 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:56.611428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 650/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 05:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:56.617363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:56.715447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efeb16-ef0f-4fd4-b3f9-cb9b44762a76 None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:56.748159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:56.748794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:56.749078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:56.749355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:56.750177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] RBAC: Adding query filter params (role.id=ec6fc519ac424429b222f0d66bf7dc74, scope.project.id=b7c8f94b507e48319424d3a1166b5e35, user.id=48e5ad200c9f4c00b971765eff2b194a) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:56.750577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:56.752035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b9a5-e1ce-447f-aa48-e6654bad1f81 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:56.757749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 637/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 05:35:56 2022] GET /identity/v3/role_assignments?user.id=48e5ad200c9f4c00b971765eff2b194a&scope.project.id=b7c8f94b507e48319424d3a1166b5e35&role.id=ec6fc519ac424429b222f0d66bf7dc74 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:58.842308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be05be-0ef0-4fc0-9e63-7a44b8e7e4d5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:58.842838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be05be-0ef0-4fc0-9e63-7a44b8e7e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:58.842932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be05be-0ef0-4fc0-9e63-7a44b8e7e4d5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:58.844288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 651/1288] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:35:58.849489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:58.849899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:58.850047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:58.866896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:35:58.868127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:35:58.896614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:58.932866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 638/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:35:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:35:58.955536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be05be-0ef0-4fc0-9e63-7a44b8e7e4d5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:59.057134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be05be-0ef0-4fc0-9e63-7a44b8e7e4d5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:59.070016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:35:59.096770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:59.097494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:59.097774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:59.098049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:59.098695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:59.100081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:35:59.112705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:35:59.113894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:35:59.114795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 652/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:35:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:35:59.120018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:59.215413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254c97-4863-4984-80d2-5cc4b755bcf7 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:59.248578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:59.249234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:59.249516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:59.249793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:59.250492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:59.250801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:59.252195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834d00d-af3c-40bc-93b3-92e4f6cda23f None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:59.256933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 639/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 05:35:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:35:59.262848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:35:59.361918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf9054-86e3-43ad-bea0-9b1f56114ac5 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:35:59.394627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:35:59.395308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:35:59.395591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:35:59.395863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] PATH_INFO: `/v3/services` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:35:59.396554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] RBAC: Adding query filter params (type=placement) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:35:59.396858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:35:59.398232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14844583-d9fc-461a-8eea-7fde5f72d26c None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:35:59.403327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 653/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 05:35:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:36:01.412425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed47a-5c55-4911-9f66-411bdc045a0c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:01.412935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed47a-5c55-4911-9f66-411bdc045a0c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:01.413058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ed47a-5c55-4911-9f66-411bdc045a0c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:01.414341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 640/1293] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:36:01.419704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b204-3e15-46af-93db-285de85b0327 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:01.420092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b204-3e15-46af-93db-285de85b0327 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:01.420262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b204-3e15-46af-93db-285de85b0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:01.437401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-34f5b204-3e15-46af-93db-285de85b0327 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:36:01.438595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-34f5b204-3e15-46af-93db-285de85b0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:36:01.467984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:01.505545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 654/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:36:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:36:01.528226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed47a-5c55-4911-9f66-411bdc045a0c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:01.558817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:01.628066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ed47a-5c55-4911-9f66-411bdc045a0c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:01.661380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:01.662035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:01.662317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:01.662593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:01.663341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:01.664704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3598-f7de-4ed3-a12b-2ce1a5c560ef None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:01.677316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 641/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 05:36:01 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:36:03.676153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdc861-7959-4c94-b614-967e0dd7066e None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:03.676675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdc861-7959-4c94-b614-967e0dd7066e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:03.676675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdc861-7959-4c94-b614-967e0dd7066e None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:03.677998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 655/1296] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:36:03.683830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:03.684220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:03.684390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:03.701327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:36:03.702507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:36:03.771883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 642/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:36:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:36:03.794923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdc861-7959-4c94-b614-967e0dd7066e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:03.894598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdc861-7959-4c94-b614-967e0dd7066e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:03.927270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:03.927995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:03.928275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:03.928547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:03.929192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:03.930546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:36:03.942625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:36:03.943916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:03.944786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 656/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:36:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:36:03.949866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:03.967813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:04.051964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c9078-0260-4974-9975-73ea2e57b24a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:04.089394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097c87-e950-46ea-b473-12cba831567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:04.090139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097c87-e950-46ea-b473-12cba831567a None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:04.090422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097c87-e950-46ea-b473-12cba831567a None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:04.090675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097c87-e950-46ea-b473-12cba831567a None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:04.091404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18097c87-e950-46ea-b473-12cba831567a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:36:04.091811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18097c87-e950-46ea-b473-12cba831567a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:04.093091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18097c87-e950-46ea-b473-12cba831567a None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:04.098374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 643/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 05:36:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:36:04.105513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:04.137085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:04.204508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274255-6f04-41a0-a83b-b73cd8764d61 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:04.237697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:04.238337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:04.238619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:04.238895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:04.239700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] RBAC: Adding query filter params (interface=public, service_id=37faf3ceb5c84a5ba131ce07e0d76491, region_id=RegionOne) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:36:04.240011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:04.241366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f98ab-f7ea-4243-9b11-5e90f275f0fe None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:04.246308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 657/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 05:36:04 2022] GET /identity/v3/endpoints?service_id=37faf3ceb5c84a5ba131ce07e0d76491&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:36:04.252039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097c87-e950-46ea-b473-12cba831567a None admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:04.329635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:04.348094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097c87-e950-46ea-b473-12cba831567a None admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:04.381516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:04.382162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:04.382465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:04.382734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:04.383428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:04.384778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497958b-e350-41c5-8422-ab68a90f0890 None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:04.392047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 644/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 05:36:04 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:36:06.385118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22c54-ea63-4ea2-b098-2db1f966d1cc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:06.385638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22c54-ea63-4ea2-b098-2db1f966d1cc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:06.385638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22c54-ea63-4ea2-b098-2db1f966d1cc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:06.387770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 658/1302] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:36:06.392934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:06.393356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:06.393475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:06.410235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:36:06.411459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:36:06.475749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 645/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:36:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:36:06.498346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22c54-ea63-4ea2-b098-2db1f966d1cc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:06.590709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:06.597843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22c54-ea63-4ea2-b098-2db1f966d1cc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:06.630665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:06.631475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:06.631755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:06.632025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:06.632655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:06.633997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:36:06.646432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:36:06.647625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application with Lock( Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: ERROR keystone.server.flask.application Jul 25 05:36:06.648810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 659/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 05:36:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:36:06.653797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:06.727930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:06.751058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b177-f253-4ee8-b3eb-3f626793b106 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:06.783783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:06.784440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:06.784726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:06.785004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] PATH_INFO: `/v3/services` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:06.785706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:36:06.786015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:06.787422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29fa08-b1f7-47b9-be84-29d142b1796e None admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:06.792631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 646/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 05:36:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:36:06.798144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:36:06.895809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b58c2-f597-4532-b79d-e0f04c274d30 None admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:36:06.927922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:36:06.928557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:36:06.928835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:36:06.929108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:36:06.929823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:36:06.931192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc864f-5ae8-44f9-9695-003b66f6e5c1 None admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:36:06.949372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 660/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 05:36:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:36:16.789540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=30 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:36:16.944917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:09.387439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278b6b-05fb-4d4a-a060-c0f2c9b85177 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:09.387908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278b6b-05fb-4d4a-a060-c0f2c9b85177 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:09.388001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43278b6b-05fb-4d4a-a060-c0f2c9b85177 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:09.393082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 647/1307] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:09.394586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77286d-c58f-4dcd-9595-866191317a4a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:09.394991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77286d-c58f-4dcd-9595-866191317a4a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:09.395241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77286d-c58f-4dcd-9595-866191317a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:09.490459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9c77286d-c58f-4dcd-9595-866191317a4a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:09.491963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9c77286d-c58f-4dcd-9595-866191317a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:09.632044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 661/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:09.685481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:09.685768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:09.686054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:09.687488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 648/1309] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 25 05:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:09.698912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a594-94d9-4b59-83f0-6915cff5c616 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:09.699314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a594-94d9-4b59-83f0-6915cff5c616 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:09.699666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343a594-94d9-4b59-83f0-6915cff5c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:09.786845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d343a594-94d9-4b59-83f0-6915cff5c616 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:09.788211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d343a594-94d9-4b59-83f0-6915cff5c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:09.811222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:09.877338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 662/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 25 05:37:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:09.887238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:09.889089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:10.001108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df108c-6e30-438e-954c-86d59c48d6d6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:10.077867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:10.078523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:10.078811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:10.079093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:10.080802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:10.139087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:10.197400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:10.198849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef2131-a303-4fae-99d1-fb83ed319ab8 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:10.219191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 649/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:12.579831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:12.580360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:12.580449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:12.581796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 663/1312] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:12.587672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7978-4f42-47dd-b1ee-c2a1b13bc488 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:12.588103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7978-4f42-47dd-b1ee-c2a1b13bc488 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:12.588228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7978-4f42-47dd-b1ee-c2a1b13bc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:12.658780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-934d7978-4f42-47dd-b1ee-c2a1b13bc488 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:12.659959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-934d7978-4f42-47dd-b1ee-c2a1b13bc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:12.764838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 650/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:12.804499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:12.806705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:12.910779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39d243-4ed8-4ce3-ad75-9edabac0c7d1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:12.985837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:12.988634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:12.989560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:12.990071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:12.990523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:12.992218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:13.104155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:13.105427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d0ea1-67b4-4aca-a58c-17d371a913f8 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:13.124386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 664/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:15.455702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:15.456255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:15.456255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:15.457646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 651/1315] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:15.463929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9476e-735e-4ee0-b921-926757ff9e33 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:15.464367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9476e-735e-4ee0-b921-926757ff9e33 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:15.464474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9476e-735e-4ee0-b921-926757ff9e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:15.530160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-37a9476e-735e-4ee0-b921-926757ff9e33 None None] MFA Rules not processed for user `40402998d0af4bdca18971d5a96264c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:15.531400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-37a9476e-735e-4ee0-b921-926757ff9e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:15.585937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:15.637458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 665/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:15.677470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:15.679052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:15.690020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:15.785253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c56499-4790-431e-a5f1-b86429231f4d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:15.859857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:15.860523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:15.860802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:15.861075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:15.862732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:15.924940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:15.971352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:15.972789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a77178-a720-485b-a5a4-d358e4fde803 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:15.990916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 652/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:18.654629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:18.655184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:18.655184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:18.656584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 666/1318] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:18.661602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ce13-9c5f-4e4a-a22b-6ad45497c1a7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:18.662033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ce13-9c5f-4e4a-a22b-6ad45497c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:18.662152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ce13-9c5f-4e4a-a22b-6ad45497c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:18.725896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bff0ce13-9c5f-4e4a-a22b-6ad45497c1a7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:18.727093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bff0ce13-9c5f-4e4a-a22b-6ad45497c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:18.820088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 653/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:18.859206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:18.860779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:18.962796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44068d03-5404-4a51-9e84-8c492e987f4d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:19.035976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:19.036725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:19.037034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:19.037337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:19.039282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:19.048203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:19.148922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:19.150474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb4dd-6141-422a-838e-fdd7951f3324 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:19.169351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 667/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:21.855355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:21.855884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:21.855884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:21.857280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 654/1321] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:21.862435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304a5c-f95c-4ed5-a4f6-df4f5fb82c23 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:21.862874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304a5c-f95c-4ed5-a4f6-df4f5fb82c23 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:21.863002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304a5c-f95c-4ed5-a4f6-df4f5fb82c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:21.928782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1d304a5c-f95c-4ed5-a4f6-df4f5fb82c23 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:21.929978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1d304a5c-f95c-4ed5-a4f6-df4f5fb82c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:21.989169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:22.033416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 668/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:22.071538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:22.073188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:22.094142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:22.185324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9826-801a-45bf-a9e9-7b7ca5891805 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:22.259388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:22.260032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:22.260311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:22.260583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:22.262220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:22.332259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:22.374886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:22.376455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cac34c-c3bb-48f6-9c7c-7bb33e7b28ad service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:22.396441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 655/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:24.543723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:24.544246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:24.544246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:24.545586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 669/1324] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:24.551959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b64a9-9691-4341-9fee-bbe19503aac1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:24.552419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b64a9-9691-4341-9fee-bbe19503aac1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:24.552510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b64a9-9691-4341-9fee-bbe19503aac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:24.622858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-573b64a9-9691-4341-9fee-bbe19503aac1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:24.624502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-573b64a9-9691-4341-9fee-bbe19503aac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:24.729453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 656/1325] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:24.766144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:24.767774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:24.882061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de707d-98da-4d88-ac09-79a4690af9b3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:24.961089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:24.962482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:24.962763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:24.963042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:24.964826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:24.981907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:25.079262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:25.080721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29e1ac-cf72-43f3-8fbe-04321b4db574 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:25.108389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 670/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:27.200961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:27.201486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:27.201486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:27.202891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 657/1327] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:27.208249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd259-4edd-4584-b9c3-b21bdd62ca59 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:27.208636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd259-4edd-4584-b9c3-b21bdd62ca59 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:27.208809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadd259-4edd-4584-b9c3-b21bdd62ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:27.277159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cfadd259-4edd-4584-b9c3-b21bdd62ca59 None None] MFA Rules not processed for user `40402998d0af4bdca18971d5a96264c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:27.278389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cfadd259-4edd-4584-b9c3-b21bdd62ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:27.350182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:27.383972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 671/1328] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:27.421194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:27.422706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:27.453748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:27.528199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da566d92-e9f9-4f13-a364-320c2016171e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:27.602975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:27.603653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:27.603935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:27.604210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:27.605868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:27.683078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:27.721478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:27.722942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128173-98fc-456d-a472-29fdc7d1df4c service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:27.746174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 658/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:30.032477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88a74-61f9-46b5-a2e4-1e18aded5ef7 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:30.033030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88a74-61f9-46b5-a2e4-1e18aded5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:30.033030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88a74-61f9-46b5-a2e4-1e18aded5ef7 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:30.034361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 672/1330] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:30.040451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926f2-ee20-43e8-8f68-ce6c5c80c4e7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:30.040904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926f2-ee20-43e8-8f68-ce6c5c80c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:30.041038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926f2-ee20-43e8-8f68-ce6c5c80c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:30.107960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1cc926f2-ee20-43e8-8f68-ce6c5c80c4e7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:30.109158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1cc926f2-ee20-43e8-8f68-ce6c5c80c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:30.205034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 659/1331] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:30.254235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:30.254528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:30.254807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:30.256216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 673/1332] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 25 05:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:30.261798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a3d3-f54c-4aa5-84a0-d39eafa11c1d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:30.262085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a3d3-f54c-4aa5-84a0-d39eafa11c1d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:30.262361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a3d3-f54c-4aa5-84a0-d39eafa11c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:30.307157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:30.338645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6bc0a3d3-f54c-4aa5-84a0-d39eafa11c1d None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:30.339862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6bc0a3d3-f54c-4aa5-84a0-d39eafa11c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:30.415266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 660/1333] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 25 05:37:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:30.424059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:30.425564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:30.529299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e006c-e00a-4c8d-aa89-fd46f773b5ba None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:30.603937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:30.604579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:30.604857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:30.605131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:30.606736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:30.633345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:30.714648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:30.716140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a11be-a5b4-476f-95be-55d05e942e78 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:30.735106 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 674/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:33.021801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:33.022393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:33.022393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:33.023845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 661/1335] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:33.029171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bb82-4e84-4f45-87a3-76c3aec76604 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:33.029561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bb82-4e84-4f45-87a3-76c3aec76604 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:33.029731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13bb82-4e84-4f45-87a3-76c3aec76604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:33.093309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4e13bb82-4e84-4f45-87a3-76c3aec76604 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:33.094532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4e13bb82-4e84-4f45-87a3-76c3aec76604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:33.168977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:33.192094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 675/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:33.232812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:33.234346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:33.336728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43f943-12a4-45df-af94-fe9b63992cb9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:33.365453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:33.410229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:33.410879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:33.411189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:33.411471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:33.413118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:33.522847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:33.524363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d18941-9049-4a39-86c2-0f8546c30bab service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:33.542045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 662/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:36.200836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:36.201396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:36.201396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:36.202779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 676/1338] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:36.207938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19d2b-5415-4730-b97a-226d6c8f19df None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:36.208362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19d2b-5415-4730-b97a-226d6c8f19df None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:36.208532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19d2b-5415-4730-b97a-226d6c8f19df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:36.271995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-59f19d2b-5415-4730-b97a-226d6c8f19df None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:36.273193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59f19d2b-5415-4730-b97a-226d6c8f19df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:36.282061 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:36.375675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 663/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:36.412886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:36.414433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:36.516418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea8c6c-2e60-44de-9802-63301b3062d5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:36.588704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:36.589345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:36.589624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:36.589894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:36.591539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:36.626394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:36.698570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:36.700030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa60ae-2511-45e7-bdf1-e8c138d82253 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:36.718905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 677/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:40.662912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:40.663493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:40.663493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:40.665764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 664/1341] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:40.671234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38bb-b598-4720-9768-7cb20aea5600 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:40.671770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38bb-b598-4720-9768-7cb20aea5600 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:40.671770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38bb-b598-4720-9768-7cb20aea5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:40.736784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-dd2e38bb-b598-4720-9768-7cb20aea5600 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:40.737918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dd2e38bb-b598-4720-9768-7cb20aea5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:40.822940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:40.834599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 678/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:40.874938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:40.876540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:40.981456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9eb60-2a8a-4cd5-8ffe-34d439f6ab7d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:41.019825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:41.058937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:41.059622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:41.059909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:41.060188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:41.061828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:41.179416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:41.180909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f3a29-cac3-4953-a6cc-35d3b9f1a6b0 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:41.199157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 665/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:44.043303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:44.043857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:44.043857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:44.045271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 679/1344] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:44.050430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904c34-b287-46ea-9169-f5d14830f45e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:44.050832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904c34-b287-46ea-9169-f5d14830f45e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:44.051020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904c34-b287-46ea-9169-f5d14830f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:44.118295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1e904c34-b287-46ea-9169-f5d14830f45e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:44.119546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1e904c34-b287-46ea-9169-f5d14830f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:44.138898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:44.235579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 666/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:44.264538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:44.266193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:44.378347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeaa10-6fcb-40cc-af73-4c695355ea9d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:44.457971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:44.458735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:44.459090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:44.459475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:44.462040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:44.508771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:44.576127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:44.577576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99940e85-08fe-451e-98d5-13300fb055e4 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:44.598658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 680/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:48.701932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:48.702481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:48.702481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:48.703939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 667/1347] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:48.709691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1482f-f645-454a-b032-c15a0104a91c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:48.710163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1482f-f645-454a-b032-c15a0104a91c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:48.710272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1482f-f645-454a-b032-c15a0104a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:48.781964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-80a1482f-f645-454a-b032-c15a0104a91c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:48.783229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-80a1482f-f645-454a-b032-c15a0104a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:48.884915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:48.888632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 681/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:48.927701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:37:48.929272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:49.037915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d8a4f-68e1-4145-83ec-d62c9e198e11 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:37:49.093027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:49.133284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:37:49.133932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:49.134208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:49.134477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:49.136128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:49.256662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:37:49.258151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486df6-7413-43df-a0ce-c1b9ee01fcaf service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:37:49.277497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 668/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:37:54.156499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60508e8-1f93-43fb-9219-968e4566bcdb None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:54.156922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60508e8-1f93-43fb-9219-968e4566bcdb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:54.157109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60508e8-1f93-43fb-9219-968e4566bcdb None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:54.158603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 682/1350] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:54.169029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b076-6602-446d-8716-6826802a477d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:54.170053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b076-6602-446d-8716-6826802a477d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:54.170631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b076-6602-446d-8716-6826802a477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:54.325203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cb11b076-6602-446d-8716-6826802a477d None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:54.326742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cb11b076-6602-446d-8716-6826802a477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:54.362087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:54.468035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 669/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:37:58.485983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7fe7d-851c-43b3-a2a9-e3268dff14ba None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:58.486870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7fe7d-851c-43b3-a2a9-e3268dff14ba None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:58.487174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7fe7d-851c-43b3-a2a9-e3268dff14ba None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:58.488879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 683/1352] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:37:58.494782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7faf0-76fd-4b7d-830d-f35fe871701e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:37:58.495423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7faf0-76fd-4b7d-830d-f35fe871701e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:37:58.495423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7faf0-76fd-4b7d-830d-f35fe871701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:37:58.579593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cdf7faf0-76fd-4b7d-830d-f35fe871701e None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:37:58.580840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cdf7faf0-76fd-4b7d-830d-f35fe871701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:37:58.657038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:37:58.696281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 670/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:00.164101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3039-dfb4-41fd-bc5e-e1b0120c9a2a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:00.164682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3039-dfb4-41fd-bc5e-e1b0120c9a2a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:00.164682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf3039-dfb4-41fd-bc5e-e1b0120c9a2a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:00.166042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 684/1354] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:00.171514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9679c-505d-450a-8590-bf83a4934331 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:00.171950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9679c-505d-450a-8590-bf83a4934331 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:00.172239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9679c-505d-450a-8590-bf83a4934331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:00.248870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2dd9679c-505d-450a-8590-bf83a4934331 None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:00.250182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2dd9679c-505d-450a-8590-bf83a4934331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:00.361986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 671/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:03.825557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c871b-3d39-4896-8536-8247cb9cf037 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:03.826397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c871b-3d39-4896-8536-8247cb9cf037 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:03.826833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c871b-3d39-4896-8536-8247cb9cf037 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:03.828930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 685/1356] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:03.835185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320409b-8eb7-4aed-850c-92125d987d95 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:03.835185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320409b-8eb7-4aed-850c-92125d987d95 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:03.835185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320409b-8eb7-4aed-850c-92125d987d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:03.874294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:03.912229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b320409b-8eb7-4aed-850c-92125d987d95 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:03.914098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b320409b-8eb7-4aed-850c-92125d987d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:04.016724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 672/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:04.072983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:04.073273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:04.073557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:04.074947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 686/1358] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 05:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:38:04.083391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c2f-18e1-42d3-86eb-6e682270e095 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:04.083686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c2f-18e1-42d3-86eb-6e682270e095 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:04.083976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151c2f-18e1-42d3-86eb-6e682270e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:04.172533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c3151c2f-18e1-42d3-86eb-6e682270e095 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:04.173907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c3151c2f-18e1-42d3-86eb-6e682270e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:04.228704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:04.317617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 673/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:38:04.326297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:04.328036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:04.483054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fc74-2735-4c67-a5d1-b33ac8d6b279 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:04.561724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:04.607305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:04.607964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:04.608249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:04.608533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:04.610191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:04.708054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:04.709891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80108ab-bfa5-4bbe-94e4-4989acabf7de service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:04.730031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 687/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:06.985963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:06.986544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:06.986544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:06.988167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 674/1361] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:06.994346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c82a7-9b1d-4dcd-841b-ef00e8d87624 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:06.994830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c82a7-9b1d-4dcd-841b-ef00e8d87624 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:06.994931 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c82a7-9b1d-4dcd-841b-ef00e8d87624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:07.067907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8e0c82a7-9b1d-4dcd-841b-ef00e8d87624 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:07.069118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8e0c82a7-9b1d-4dcd-841b-ef00e8d87624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:07.109849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:07.173587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 688/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:07.220822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:07.222428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:07.403230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd058a-8cbc-409e-be0f-ee417c6e405d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:07.413157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:07.537655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:07.538277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:07.538753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:07.538941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:07.540537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:07.633042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:07.634673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b5b42-32fd-49c5-9e07-ed1628ce5e20 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:07.653441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 675/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:10.057832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d07b-3788-44f9-b943-3142076fdc10 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:10.058355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d07b-3788-44f9-b943-3142076fdc10 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:10.058355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078d07b-3788-44f9-b943-3142076fdc10 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:10.059727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 689/1364] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:10.065286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e2454-37e6-496b-ae5f-ce9bf8f90352 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:10.065900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e2454-37e6-496b-ae5f-ce9bf8f90352 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:10.066186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e2454-37e6-496b-ae5f-ce9bf8f90352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:10.082498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:10.150566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-582e2454-37e6-496b-ae5f-ce9bf8f90352 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:10.152131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-582e2454-37e6-496b-ae5f-ce9bf8f90352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:10.257954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 676/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:10.305046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:10.305591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:10.306098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:10.308086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 690/1366] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 05:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:10.314488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a8c0-76f3-4131-ac8b-db14be697118 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:10.314777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a8c0-76f3-4131-ac8b-db14be697118 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:10.315058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06a8c0-76f3-4131-ac8b-db14be697118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:10.400166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5b06a8c0-76f3-4131-ac8b-db14be697118 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:10.401391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5b06a8c0-76f3-4131-ac8b-db14be697118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:10.438278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:10.529570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 677/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:10.539377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:10.540961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:10.701323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75326-463c-4bfb-9ae6-f80369c6bea7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:10.723162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:10.823785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b672c-64da-4135-85dc-437085cc546e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:10.824440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b672c-64da-4135-85dc-437085cc546e service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:10.824725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b672c-64da-4135-85dc-437085cc546e service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:10.824999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b672c-64da-4135-85dc-437085cc546e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:10.826626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-967b672c-64da-4135-85dc-437085cc546e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:10.921965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b672c-64da-4135-85dc-437085cc546e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:10.923565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b672c-64da-4135-85dc-437085cc546e service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:10.942374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 691/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:11.999515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48ca9-5397-42ff-90b5-3afcd066e159 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:12.000096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48ca9-5397-42ff-90b5-3afcd066e159 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:12.000096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48ca9-5397-42ff-90b5-3afcd066e159 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:12.001622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 678/1369] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:12.006675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee9a4-74a3-4a4b-b858-63a08b14801b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:12.007690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee9a4-74a3-4a4b-b858-63a08b14801b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:12.007858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee9a4-74a3-4a4b-b858-63a08b14801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:12.039760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:12.079747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-39fee9a4-74a3-4a4b-b858-63a08b14801b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:12.080960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-39fee9a4-74a3-4a4b-b858-63a08b14801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:12.194843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 692/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:12.541306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:12.541601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:12.541887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:12.543387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 679/1371] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 25 05:38:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:12.548708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc624f-2742-41ac-a29a-6722c0416dbc None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:12.549069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc624f-2742-41ac-a29a-6722c0416dbc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:12.549618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc624f-2742-41ac-a29a-6722c0416dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:12.631408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-67cc624f-2742-41ac-a29a-6722c0416dbc None None] MFA Rules not processed for user `9e060788d6f54f4d9fcbccdb720c3500`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:12.632793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-67cc624f-2742-41ac-a29a-6722c0416dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:12.684938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:12.718031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 693/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 25 05:38:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:12.726418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:12.728842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:12.843600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e05fb-d471-4775-801c-b5b4b2615072 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:12.889254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:12.929915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:12.930568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:12.930849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:12.931148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:12.932793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:13.059560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:13.061027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf219-b2f3-4686-8d06-5eef5e2457df service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:13.082494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 680/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:13.093228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:13.093640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:13.093802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:13.095249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 694/1374] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:13.100100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e86a-b0e6-408e-a3a3-fee983ff8992 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:13.100398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e86a-b0e6-408e-a3a3-fee983ff8992 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:13.100865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e86a-b0e6-408e-a3a3-fee983ff8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:13.166378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e129e86a-b0e6-408e-a3a3-fee983ff8992 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:13.167517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e129e86a-b0e6-408e-a3a3-fee983ff8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:13.188763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:13.272408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 681/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:13.321189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:13.327288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:13.521731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eeca3-89be-487b-9bea-e5450e83e078 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:13.575019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:13.638318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:13.638974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:13.639296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:13.639579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:13.641265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:13.732766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:13.734480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4cd3b-7c64-4fa0-b1a1-022476ca2864 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:13.753103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 695/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:15.798387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:15.798939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:15.798939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:15.800387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 682/1377] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:15.806091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4faedd-43b7-4e86-ac1f-667089e5bf0f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:15.806511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4faedd-43b7-4e86-ac1f-667089e5bf0f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:15.806647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4faedd-43b7-4e86-ac1f-667089e5bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:15.872235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6d4faedd-43b7-4e86-ac1f-667089e5bf0f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:15.873458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6d4faedd-43b7-4e86-ac1f-667089e5bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:15.888076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:15.976347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 696/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:16.020514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:16.022025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:16.188436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc038a04-0439-4df6-9767-e958dfc04918 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:16.191908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:16.301137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:16.301819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:16.302102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:16.302379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:16.304117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:16.401571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:16.403381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5d19e-c9f8-44b4-9d83-8fcec65b9d6d service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:16.424049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 683/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:18.541738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:18.542241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:18.542241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:18.543799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 697/1380] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:18.548931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d77f5-5279-4192-a98b-8b950800abea None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:18.549374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d77f5-5279-4192-a98b-8b950800abea None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:18.549549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d77f5-5279-4192-a98b-8b950800abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:18.560234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:18.624507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-aa4d77f5-5279-4192-a98b-8b950800abea None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:18.625831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-aa4d77f5-5279-4192-a98b-8b950800abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:18.732580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 684/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:18.775990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:18.777646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:18.936467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:18.948484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f224de-9d9d-4e2d-b98c-793d0b66133c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:19.076332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:19.077012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:19.077290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:19.077563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:19.079207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:19.179919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:19.181430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab13828-2848-41df-ba4c-9b9a42ea36d7 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:19.192446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:19.201836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 698/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:21.292135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:21.292737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:21.292737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:21.294080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 685/1383] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:38:21.302025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced3ee-1f71-4c20-8101-88d21b4e67d2 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:21.302461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced3ee-1f71-4c20-8101-88d21b4e67d2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:21.302687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced3ee-1f71-4c20-8101-88d21b4e67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:21.376421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9eced3ee-1f71-4c20-8101-88d21b4e67d2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:21.377707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9eced3ee-1f71-4c20-8101-88d21b4e67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:21.486747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 699/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:21.530457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:21.532020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:21.657249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:21.756167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c918d7-2c6f-4749-91bb-3b6c1697e9a1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:21.919469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:21.920562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:21.921042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:21.921597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:21.924819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:21.998607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:22.048422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:22.050454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3243b-5e98-48f9-ad7f-df9e2ed9e25a service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:22.074048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 686/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:24.168443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:24.169295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:24.169295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:24.170418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 700/1386] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:24.176018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a3f8-d97d-466b-bb53-48acd4a8bd11 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:24.176443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a3f8-d97d-466b-bb53-48acd4a8bd11 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:24.176582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a3f8-d97d-466b-bb53-48acd4a8bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:24.272996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cb47a3f8-d97d-466b-bb53-48acd4a8bd11 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:24.276121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cb47a3f8-d97d-466b-bb53-48acd4a8bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:24.422649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 687/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:24.473811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:24.476982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:24.583831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:24.668401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac320739-56d5-4d8f-9162-03cfcd61fafd None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:24.808180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:24.808671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:24.808968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:24.809308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:24.811051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:24.862945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:24.934555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:24.936807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5606a-937b-49ff-b714-76f36495af76 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:24.957977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 701/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:27.073085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:27.073651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:27.073651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:27.075265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 688/1389] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:27.080548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe1ee-1fe6-4b1a-ad69-c645df8448d5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:27.080957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe1ee-1fe6-4b1a-ad69-c645df8448d5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:27.081155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe1ee-1fe6-4b1a-ad69-c645df8448d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:27.148169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-914fe1ee-1fe6-4b1a-ad69-c645df8448d5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:27.149378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-914fe1ee-1fe6-4b1a-ad69-c645df8448d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:27.246956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 702/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:27.291908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:27.293461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:27.326206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:27.442092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12e30a-6fc9-43cc-b785-959fd560abea None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:27.544627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:27.556814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:27.557466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:27.557750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:27.558029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:27.559687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:27.648839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:27.650372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f189c-799f-449a-9d8f-27d49d564124 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:27.668792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 689/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:28.215233 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3551011-65e8-4211-b745-ca7b79545fdc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:28.215770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3551011-65e8-4211-b745-ca7b79545fdc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:28.215770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3551011-65e8-4211-b745-ca7b79545fdc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:28.217209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 703/1392] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:28.222648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f8ff-8bba-44d3-9086-a81b687768cb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:28.223087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f8ff-8bba-44d3-9086-a81b687768cb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:28.223271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875f8ff-8bba-44d3-9086-a81b687768cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:28.288265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a875f8ff-8bba-44d3-9086-a81b687768cb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:28.289461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a875f8ff-8bba-44d3-9086-a81b687768cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:28.349182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:28.388756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 690/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:28.444892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:28.445349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:28.445622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:28.447014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 704/1394] 10.222.0.27 () {54 vars in 966 bytes} [Mon Jul 25 05:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:28.452330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfda3f0-710c-4c35-bbf3-f1d8d50ec7b6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:28.452612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfda3f0-710c-4c35-bbf3-f1d8d50ec7b6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:28.452887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfda3f0-710c-4c35-bbf3-f1d8d50ec7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:28.526966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5cfda3f0-710c-4c35-bbf3-f1d8d50ec7b6 None None] MFA Rules not processed for user `e0ee6a51a843460ba129d08a6c6fb910`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:28.528123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5cfda3f0-710c-4c35-bbf3-f1d8d50ec7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:28.603331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 691/1395] 10.222.0.27 () {58 vars in 1063 bytes} [Mon Jul 25 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:28.610909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:28.612549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:28.626712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:28.717185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f582b80-e404-4dc1-a38c-3d16c180d190 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:28.791980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:28.792548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:28.792825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:28.793098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:28.794723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:28.867597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:28.909993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:28.911476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22867bc-08d4-43e7-9a71-225170e72ee2 service glance] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:28.930458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 705/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:29.648064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a30ce-02e9-456d-be7e-6a4150c695ca None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:29.648590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a30ce-02e9-456d-be7e-6a4150c695ca None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:29.648722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a30ce-02e9-456d-be7e-6a4150c695ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:29.716517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ae8a30ce-02e9-456d-be7e-6a4150c695ca None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:29.717719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ae8a30ce-02e9-456d-be7e-6a4150c695ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:29.726378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:29.804932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2757d-eea4-4e5e-8e20-cbfa6c44cce0 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:29.805524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2757d-eea4-4e5e-8e20-cbfa6c44cce0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:29.805524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2757d-eea4-4e5e-8e20-cbfa6c44cce0 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:29.806019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 692/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:29.806904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 706/1398] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:38:29.812447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:29.812744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:29.813030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:29.849887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23f0b-4dbe-4b12-a7fa-8a7aa23eb46b None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:29.850820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23f0b-4dbe-4b12-a7fa-8a7aa23eb46b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:29.851348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca23f0b-4dbe-4b12-a7fa-8a7aa23eb46b None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:29.853019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 707/1399] 10.222.0.27 () {54 vars in 943 bytes} [Mon Jul 25 05:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:38:29.860085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:29.860382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:29.860666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:29.880242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:29.881481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:29.938099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] MFA Rules not processed for user `fc6a7aae669748718cff961b07facc21`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:29.939282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:29.994093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 693/1400] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:30.039720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:30.041113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:30.044431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:30.062668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 708/1401] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Jul 25 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:38:30.072358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:30.077193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:30.083155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c126b88-1c9e-4d5d-bb92-1980c5d5b0be None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:30.158554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237d34-40c6-46b8-a775-c9888890a176 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:30.194101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:30.194717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:30.195004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:30.195312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:30.197004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:30.274285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:30.276676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:30.277344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:30.277815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:30.278275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:30.280141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:30.281970 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:30.283608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7c01-5685-48f5-9b9a-69d5651e4135 service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:30.292441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 709/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:38:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:38:30.380915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:30.383333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103538-2ab6-4f75-b39a-363724566da6 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:30.405824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 694/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:38:32.519415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:32.520029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:32.520029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:32.521376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 710/1404] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:32.527821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1db0-1625-455f-8055-145541c1551e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:32.528346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1db0-1625-455f-8055-145541c1551e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:32.528432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1db0-1625-455f-8055-145541c1551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:32.610494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-acaa1db0-1625-455f-8055-145541c1551e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:32.611693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-acaa1db0-1625-455f-8055-145541c1551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:32.694831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:32.730753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 695/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:38:32.779398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:32.780911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:32.817629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:32.947054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e83e0d-89c2-48c7-8225-f3537380b59b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:33.062361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:33.075246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:33.076238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:33.076519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:33.076794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:33.078446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:33.304550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:33.306072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cd8b2-1ff5-49dd-9ef8-4e9399b37f06 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:33.324572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 711/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:35.421585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:35.422165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:35.422165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:35.427455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 696/1407] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:38:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:35.429762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ba15-01a5-48f1-96f3-0f8261b4f656 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:35.430246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ba15-01a5-48f1-96f3-0f8261b4f656 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:35.430357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ba15-01a5-48f1-96f3-0f8261b4f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:35.502757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-81e6ba15-01a5-48f1-96f3-0f8261b4f656 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:35.504158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-81e6ba15-01a5-48f1-96f3-0f8261b4f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:35.576341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:35.616777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 712/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:38:35.665666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:35.667538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:35.839273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131336cf-77cb-4302-a8ba-bdbd6bc486e0 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:35.903001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:35.968441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:35.969098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:35.969383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:35.969659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:35.971375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:36.072515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:36.074133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf9ed-6724-4c6a-bb4f-e0ab73b864e9 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:36.093402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 697/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:45.614265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=14 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:46.090845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=73 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:52.829157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b441-b94f-48a0-84e9-4810123c8007 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:52.829710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b441-b94f-48a0-84e9-4810123c8007 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:52.829710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b441-b94f-48a0-84e9-4810123c8007 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:52.831117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 713/1410] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 25 05:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:52.836497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15209-9aa6-4f36-877f-9c989af84021 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:52.836941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15209-9aa6-4f36-877f-9c989af84021 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:52.837051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15209-9aa6-4f36-877f-9c989af84021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:52.911075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-92e15209-9aa6-4f36-877f-9c989af84021 None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:52.912943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-92e15209-9aa6-4f36-877f-9c989af84021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:53.018164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 698/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 05:38:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:53.033280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52482-e0a3-4d98-b80b-d2d68630ebcb None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:53.033586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52482-e0a3-4d98-b80b-d2d68630ebcb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:53.033860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d52482-e0a3-4d98-b80b-d2d68630ebcb None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:53.035263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 714/1412] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 25 05:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:53.040578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce511d-6bdf-45c0-94d6-92a71908e91c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:53.040864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce511d-6bdf-45c0-94d6-92a71908e91c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:53.041167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce511d-6bdf-45c0-94d6-92a71908e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:53.112861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:53.115906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-3bce511d-6bdf-45c0-94d6-92a71908e91c None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:53.117656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3bce511d-6bdf-45c0-94d6-92a71908e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:53.233587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 699/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:55.740636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:55.741158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:55.741268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:55.742588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:55.747877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03deb2-cb2b-4525-b10a-72ce512c673d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:55.748284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03deb2-cb2b-4525-b10a-72ce512c673d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:55.748442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03deb2-cb2b-4525-b10a-72ce512c673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:55.811484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5c03deb2-cb2b-4525-b10a-72ce512c673d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:55.812676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5c03deb2-cb2b-4525-b10a-72ce512c673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:55.867008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:55.910029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:55.953442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:55.955064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:56.102304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a41b-a0df-40ab-980a-04d59c8dd213 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:56.174573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:56.216540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:56.217188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:56.217467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:56.217735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:56.219395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:56.307364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:56.308965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5519a54-c74c-4ea7-9186-7838fc51b2e9 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:56.331839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 716/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:57.237301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:57.237826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:57.237826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:57.239266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:57.244258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b38e8-19a5-49a9-90ad-6d65dd9a2996 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:57.244642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b38e8-19a5-49a9-90ad-6d65dd9a2996 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:57.244816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b38e8-19a5-49a9-90ad-6d65dd9a2996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:57.318802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-721b38e8-19a5-49a9-90ad-6d65dd9a2996 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:57.320048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-721b38e8-19a5-49a9-90ad-6d65dd9a2996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:57.347116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:57.418235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:57.568599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:57.570107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:57.715365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c0fd-d8a6-4d69-ac2e-38fb10f83b79 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:57.755050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:57.827562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:57.828198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:57.828483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:57.828758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:57.830378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:57.919970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:57.921580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9e6a7-ee54-41f7-b046-aefd9387b8a7 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:57.939484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 702/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:38:58.817549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:58.818729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:58.818729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:58.820001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:38:58.824911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffb1e-97c9-4d8a-91bd-4def83435989 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:58.825308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffb1e-97c9-4d8a-91bd-4def83435989 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:58.825466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffb1e-97c9-4d8a-91bd-4def83435989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:58.878140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:58.900993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-094ffb1e-97c9-4d8a-91bd-4def83435989 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:38:58.902185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-094ffb1e-97c9-4d8a-91bd-4def83435989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:58.995575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:38:59.145625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:38:59.147581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:59.291812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd48c22-131f-4afa-967d-5dc662a00628 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:38:59.304434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:38:59.406854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:38:59.407467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:38:59.407749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:38:59.408028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:38:59.409663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:38:59.498733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:38:59.500357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb4358-e12c-4cf9-aea8-1db46fce7754 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:38:59.518112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 719/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:00.372847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:00.373320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:00.373434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:00.374861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:00.380629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aba66-3503-4818-8b95-f19612cae7b6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:00.381136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aba66-3503-4818-8b95-f19612cae7b6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:00.381230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aba66-3503-4818-8b95-f19612cae7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:00.400019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:00.456388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e87aba66-3503-4818-8b95-f19612cae7b6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:00.457598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e87aba66-3503-4818-8b95-f19612cae7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:00.554788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:00.706176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:00.707644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:00.814644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:00.850804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1dee-1aaf-43cb-ab29-0791d6d94b68 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:00.960780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:00.961357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:00.961644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:00.961924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:00.963643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:01.039386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:01.053351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:01.054948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf5f14-feec-4f3b-a876-526ca54c6b9e service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:01.073319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 705/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:01.935604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:01.936204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:01.936204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:01.937592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:01.942405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790c0-c59c-4316-8a56-eb15862fe9fe None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:01.943397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790c0-c59c-4316-8a56-eb15862fe9fe None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:01.943601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790c0-c59c-4316-8a56-eb15862fe9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:02.018358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a06790c0-c59c-4316-8a56-eb15862fe9fe None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:02.019580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a06790c0-c59c-4316-8a56-eb15862fe9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:02.113563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:02.262657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:02.264152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:02.348120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:02.412580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98481ae-1bf2-4355-8e2a-efa4a7e5d7db None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:02.527722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:02.528295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:02.528567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:02.528836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:02.530445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:02.578045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:02.620309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:02.621915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cf61a-5ff8-47ac-baea-06c4d29ad0a8 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:02.640583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 722/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:03.449868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:03.450471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:03.450471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:03.451813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:03.456633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7b9d-a6bc-4c38-b63c-72ebbf9feac9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:03.457038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7b9d-a6bc-4c38-b63c-72ebbf9feac9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:03.457187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f7b9d-a6bc-4c38-b63c-72ebbf9feac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:03.531927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b47f7b9d-a6bc-4c38-b63c-72ebbf9feac9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:03.533139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b47f7b9d-a6bc-4c38-b63c-72ebbf9feac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:03.630049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:03.779280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:03.780726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:03.829882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:03.928403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1eb64-dc3e-4c92-8949-c4342b0e8227 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:04.040070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:04.040644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:04.040928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:04.041205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:04.042840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:04.049975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:04.133018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:04.134624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf712e5-d29d-47d2-89a2-5ef468ca3339 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:04.152322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 708/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:04.979705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:04.980283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:04.980283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:04.981701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:04.986977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809edf5-3a19-48eb-bc4d-8a2e29c1df01 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:04.987426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809edf5-3a19-48eb-bc4d-8a2e29c1df01 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:04.987614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809edf5-3a19-48eb-bc4d-8a2e29c1df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:05.061221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a809edf5-3a19-48eb-bc4d-8a2e29c1df01 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:05.062418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a809edf5-3a19-48eb-bc4d-8a2e29c1df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:05.129168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:05.157771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:05.304955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:05.306391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:05.323947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:05.453091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76a03-c10d-46ea-a770-2dd37fd8f04a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:05.541363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:05.567378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:05.568855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:05.569175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:05.569435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:05.571052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:05.660337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:05.662362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfee325-ab6e-4b75-9408-c649731e9633 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:05.680249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 725/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:06.498130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:06.498690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:06.498690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:06.500102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:06.504898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d391-24cb-425a-95b1-99dc1ac537e9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:06.505994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d391-24cb-425a-95b1-99dc1ac537e9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:06.506104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07d391-24cb-425a-95b1-99dc1ac537e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:06.580037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9b07d391-24cb-425a-95b1-99dc1ac537e9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:06.581250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9b07d391-24cb-425a-95b1-99dc1ac537e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:06.624267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:06.680194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:06.831993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:06.833472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:06.977215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c04e-b725-475e-8bfa-080af1eebe98 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:07.030237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:07.090300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:07.090876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:07.091176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:07.091451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:07.093098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:07.181175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:07.182768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121aef1-065e-47b3-9585-e5a6b45aeb79 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:07.201060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 711/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:08.004179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:08.004653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:08.004759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:08.006718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:08.011715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44297-8c59-4d21-9367-317c69019781 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:08.012181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44297-8c59-4d21-9367-317c69019781 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:08.012286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44297-8c59-4d21-9367-317c69019781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:08.086974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d1d44297-8c59-4d21-9367-317c69019781 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:08.088250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d1d44297-8c59-4d21-9367-317c69019781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:08.090270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:08.184627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:08.333800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:08.335405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:08.480517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd25-5a2e-41ea-ac23-cef805c08fd3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:08.508326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:08.594390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:08.595041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:08.595357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:08.595636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:08.597305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:08.688982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:08.690569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0d672-0073-478c-b49a-361854ec15a1 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:08.709595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 728/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:10.627583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:10.628099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:10.628099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:10.629450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:10.635580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3248b-bef8-4fd7-9c3b-8f4190cc22df None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:10.636026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3248b-bef8-4fd7-9c3b-8f4190cc22df None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:10.636123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3248b-bef8-4fd7-9c3b-8f4190cc22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:10.674991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:10.700081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-46e3248b-bef8-4fd7-9c3b-8f4190cc22df None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:10.701291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-46e3248b-bef8-4fd7-9c3b-8f4190cc22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:10.795479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:10.835005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:10.836627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:10.939839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907260d-9473-44db-9d05-3f9fb94084f6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:10.972492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:11.015399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:11.016043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:11.016325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:11.016604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:11.018235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:11.126356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:11.127847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f40b-4cdf-454a-a89a-f4e795641d83 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:11.147779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 714/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:13.328390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:13.328949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:13.328949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:13.330315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:13.335712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbff27-a4b8-4341-8042-af60a448fac8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:13.336152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbff27-a4b8-4341-8042-af60a448fac8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:13.336296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbff27-a4b8-4341-8042-af60a448fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:13.401569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-99dbff27-a4b8-4341-8042-af60a448fac8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:13.402712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-99dbff27-a4b8-4341-8042-af60a448fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:13.415091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:13.498347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:13.536471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:13.537983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:13.642412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ccae8-0365-4eea-8e74-388c782488b5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:13.654566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:13.716980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:13.717626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:13.717907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:13.718176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:13.720150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:13.828890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:13.830313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2460a9f-768e-491f-86ef-a4a07f0d7b20 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:13.848442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 731/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:16.205740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:16.206272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:16.206272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:16.207759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:16.213721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c859a-b179-48cd-ba7e-9bd624a67f3e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:16.214127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c859a-b179-48cd-ba7e-9bd624a67f3e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:16.214269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c859a-b179-48cd-ba7e-9bd624a67f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:16.261491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:16.279265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-269c859a-b179-48cd-ba7e-9bd624a67f3e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:16.280480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-269c859a-b179-48cd-ba7e-9bd624a67f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:16.389345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:16.432324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:16.434531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:16.538403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f718c-afa2-4476-aecf-c53fb784b643 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:16.578558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:16.613008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:16.613661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:16.613946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:16.614863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:16.616646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:16.731769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:16.733205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397bbf-1d5b-42e4-a001-c16a4165791e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:16.751590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 717/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:18.917696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:18.918231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:18.918231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:18.919712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:18.925076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002494-8963-4271-a32a-cdbb206eab42 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:18.925474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002494-8963-4271-a32a-cdbb206eab42 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:18.925645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002494-8963-4271-a32a-cdbb206eab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:18.992022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-57002494-8963-4271-a32a-cdbb206eab42 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:18.993207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-57002494-8963-4271-a32a-cdbb206eab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:19.013510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:19.091226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:19.132603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:19.134139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:19.237757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41612f77-bf7c-4e16-bd6e-c1de9cd8e3f2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:19.257380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:19.312055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:19.312704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:19.312988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:19.313268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:19.314912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:19.426079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:19.428049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b09b2-2951-4390-8d25-3fbd8030cecb service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:19.446841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 734/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:21.610585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:21.611176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:21.611176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:21.612547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:21.618001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b06a-878b-4145-bc13-66dfc18a9750 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:21.618433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b06a-878b-4145-bc13-66dfc18a9750 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:21.618538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b06a-878b-4145-bc13-66dfc18a9750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:21.680898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:21.683841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5589b06a-878b-4145-bc13-66dfc18a9750 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:21.685656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5589b06a-878b-4145-bc13-66dfc18a9750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:21.781534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:21.820333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:21.821849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:21.925783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c98a2-a4a3-4a12-9755-e8d025c35121 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:21.974784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:21.999384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:22.000035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:22.000316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:22.000591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:22.002213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:22.109925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:22.111398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5ba2a-1759-4e25-bebd-5060b8ac806c service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:22.129169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 720/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:24.207482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:24.208696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:24.208799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:24.210120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:24.215519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7dde1-b8e7-4d7c-9ba4-71dd63c114b8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:24.215949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7dde1-b8e7-4d7c-9ba4-71dd63c114b8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:24.216071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7dde1-b8e7-4d7c-9ba4-71dd63c114b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:24.286332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-53e7dde1-b8e7-4d7c-9ba4-71dd63c114b8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:24.287611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-53e7dde1-b8e7-4d7c-9ba4-71dd63c114b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:24.319282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:24.393690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:24.435536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:24.437131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:24.546194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a130-d6f5-466b-9a3b-8d1165d6cc7c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:24.576261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:24.625665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:24.626320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:24.626598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:24.626869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:24.628532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:24.750725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:24.752206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf566-34b0-4340-a96a-96affaedab97 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:24.772284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 737/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:26.875085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:26.875665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:26.875665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:26.877055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:26.882414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c8d-67d6-4427-a137-57eb37ddc0c5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:26.882844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c8d-67d6-4427-a137-57eb37ddc0c5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:26.883003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923c8d-67d6-4427-a137-57eb37ddc0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:26.947993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-33923c8d-67d6-4427-a137-57eb37ddc0c5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:26.949201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-33923c8d-67d6-4427-a137-57eb37ddc0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:26.957465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:27.047424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:27.084763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:27.086304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:27.189628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bd6eb-140d-4f2b-a69b-ff68f19aeb6f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:27.244053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:27.263044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:27.263723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:27.264009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:27.264288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:27.265932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:27.374432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:27.375903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f2db5-044c-4bbe-a72e-ac39e20ce0a3 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:27.393849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 723/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:29.462697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:29.463223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:29.463223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:29.464584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:29.469819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acb786-3c39-40bd-84a4-6055bbbe36dd None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:29.470253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acb786-3c39-40bd-84a4-6055bbbe36dd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:29.470384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acb786-3c39-40bd-84a4-6055bbbe36dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:29.535269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-94acb786-3c39-40bd-84a4-6055bbbe36dd None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:29.536984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-94acb786-3c39-40bd-84a4-6055bbbe36dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:29.575035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:29.634994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:39:29.672357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:29.673922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:29.777635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a7e0-68a2-4d36-9cbe-c147675d3e4a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:29.814933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:29.851556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:29.852212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:29.852492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:29.852769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:29.854664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:29.965945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:29.967423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9e45-3959-4aa1-9977-5f7394a20bde service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:29.987357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 740/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:32.080984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:32.081558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:32.081558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:32.083218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:32.088449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095392-0682-4099-a22f-bf2e4496c5e9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:32.088854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095392-0682-4099-a22f-bf2e4496c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:32.089014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b095392-0682-4099-a22f-bf2e4496c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:32.153100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5b095392-0682-4099-a22f-bf2e4496c5e9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:32.154293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5b095392-0682-4099-a22f-bf2e4496c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:32.172229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:32.251598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:32.290136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:32.291753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:32.396500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e77b-5fec-47d6-9b7e-a65a20ce8b75 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:32.461774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:32.468772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:32.469411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:32.469688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:32.469963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:32.471602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:32.579442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:32.580893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a4f78-e28d-4df0-968f-a266f7b1fbf8 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:32.599577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 726/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:34.652282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:34.652847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:34.652847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:34.654134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:34.659317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890252e-0728-4ea4-90b4-db27a00a59ce None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:34.659737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890252e-0728-4ea4-90b4-db27a00a59ce None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:34.659873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890252e-0728-4ea4-90b4-db27a00a59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:34.730551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1890252e-0728-4ea4-90b4-db27a00a59ce None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:34.731795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1890252e-0728-4ea4-90b4-db27a00a59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:34.778875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:34.827404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:34.865242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:34.866775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:34.968615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77c9b-93bf-4bf8-995f-767b30f860e7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:35.014887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:35.041171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:35.041806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:35.042086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:35.042362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:35.044011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:35.153244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:35.154720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ef52-bbde-446e-b978-b72a774573a6 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:35.173882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 743/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:44.825529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=22 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:45.171567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=66 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:54.898239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801dfb-d306-41c7-b856-e7a781f96741 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:54.898885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801dfb-d306-41c7-b856-e7a781f96741 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:54.898885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801dfb-d306-41c7-b856-e7a781f96741 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:54.900323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 728/1471] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:54.905715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384fea-6845-48b8-8805-5a996e7ad4aa None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:54.906140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384fea-6845-48b8-8805-5a996e7ad4aa None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:54.906276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384fea-6845-48b8-8805-5a996e7ad4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:54.970247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e6384fea-6845-48b8-8805-5a996e7ad4aa None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:54.971467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e6384fea-6845-48b8-8805-5a996e7ad4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:55.068455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 744/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:55.153087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:55.153310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:55.153586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:55.155124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 729/1473] 10.222.0.27 () {54 vars in 966 bytes} [Mon Jul 25 05:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:55.159724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a841-13a1-4a5f-a60a-6340c53af5a7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:55.160624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a841-13a1-4a5f-a60a-6340c53af5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:55.160908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a841-13a1-4a5f-a60a-6340c53af5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:55.234968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5944a841-13a1-4a5f-a60a-6340c53af5a7 None None] MFA Rules not processed for user `e0ee6a51a843460ba129d08a6c6fb910`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:55.236190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5944a841-13a1-4a5f-a60a-6340c53af5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:55.257934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:55.313372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 745/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Mon Jul 25 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:55.321766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:55.323311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:55.426164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51cb94-2bdf-469b-ac76-b1e9e6602a51 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:55.497772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:55.498421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:55.498704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:55.498980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:55.500680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:55.555306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:55.610766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:55.612236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78021c60-6666-4bef-8d79-d696e504fad3 service glance] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:55.631424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 730/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:39:57.746760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:57.747358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:57.747358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:57.748758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 746/1476] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:39:57.754766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7229b3-46be-4235-86bf-5d5ead1ba38d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:57.755255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7229b3-46be-4235-86bf-5d5ead1ba38d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:57.755373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7229b3-46be-4235-86bf-5d5ead1ba38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:57.819180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2c7229b3-46be-4235-86bf-5d5ead1ba38d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:39:57.820393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2c7229b3-46be-4235-86bf-5d5ead1ba38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:57.914690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 731/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:39:57.938413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:39:57.939966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:39:58.065506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db806b-b61c-4d99-af3a-c6f756327cda None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:39:58.114680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:39:58.160499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:39:58.161336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:39:58.161617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:39:58.161888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:39:58.162612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:39:58.164353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:39:58.164353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:39:58.164353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:39:58.165489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8d7c-24c3-4c5c-9ec1-6ac8ab096dd7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:39:58.184731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 747/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 05:39:57 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:40:00.239414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:00.239945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:00.240067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:00.241377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 732/1479] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:40:00.246643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81f50-7b48-491f-943e-92f3749b7bd5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:00.247013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81f50-7b48-491f-943e-92f3749b7bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:00.247242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81f50-7b48-491f-943e-92f3749b7bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:00.310846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-39a81f50-7b48-491f-943e-92f3749b7bd5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:40:00.312083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-39a81f50-7b48-491f-943e-92f3749b7bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:00.408615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 748/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:40:00.452317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:40:00.453939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:00.464281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:00.599155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c922b-31d6-4da6-8773-4cea3ca79c15 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:40:00.678127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:00.711646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:40:00.713238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:00.713522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:00.713794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:00.715450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:00.802422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:40:00.804106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02071ad-6842-47a4-90e2-6879de06a38a service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:40:00.822009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 733/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:40:03.044644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:03.045182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:03.045182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:03.046598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 749/1482] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:40:03.052400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb4a3-6d59-4ac4-8d18-bc12257a3e5c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:03.052830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb4a3-6d59-4ac4-8d18-bc12257a3e5c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:03.052946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb4a3-6d59-4ac4-8d18-bc12257a3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:03.116510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-194bb4a3-6d59-4ac4-8d18-bc12257a3e5c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:40:03.117728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-194bb4a3-6d59-4ac4-8d18-bc12257a3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:03.163442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:03.213439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 734/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:40:03.251331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:40:03.252873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:03.276204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:03.357701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40723fb6-7116-4494-995a-a551b13324b2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:40:03.431638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:40:03.432287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:03.432573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:03.432851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:03.434492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:03.508602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:03.542891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:40:03.544365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fa63-9e93-4c50-b8c8-600b4a869333 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:40:03.564726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 750/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:40:05.640650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:05.641252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:05.641252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:05.642605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 735/1485] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:40:05.648050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec51145-8e02-44a0-84f1-5d9f50fee5ae None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:05.648499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec51145-8e02-44a0-84f1-5d9f50fee5ae None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:05.648654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec51145-8e02-44a0-84f1-5d9f50fee5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:05.714490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6ec51145-8e02-44a0-84f1-5d9f50fee5ae None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:40:05.716198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6ec51145-8e02-44a0-84f1-5d9f50fee5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:05.816501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 751/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:40:05.855197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:40:05.856738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:05.958399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07a4b4-7df8-42b1-bba2-cc0f0e4d2c3a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:40:06.027916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:06.029705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:40:06.030350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:06.030819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:06.031350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:06.033164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:06.143212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:40:06.144660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ecb0c-da84-4ead-af95-dc6f43c89bae service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:40:06.163476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 736/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:40:08.305389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:08.305944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:08.305944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:08.307412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 752/1488] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:40:08.312883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080032-346f-4359-9202-9ae1fe1b5f9e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:08.313321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080032-346f-4359-9202-9ae1fe1b5f9e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:08.313440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f080032-346f-4359-9202-9ae1fe1b5f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:08.378507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0f080032-346f-4359-9202-9ae1fe1b5f9e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:40:08.380464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0f080032-346f-4359-9202-9ae1fe1b5f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:08.433122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:08.477315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 737/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:40:08.518593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:40:08.520541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:08.557002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:08.626013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8eb2-db9d-44a5-b6f2-f9cfd5f9dd65 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:40:08.702827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:40:08.703560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:08.703840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:08.704113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:08.705737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:08.786989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:08.816939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:40:08.818562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84ddb-42f0-4020-9af7-971fae77936b service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:40:08.836908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 753/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:40:11.088472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:11.089033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:11.089033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:11.090420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 738/1491] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 05:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:40:11.095957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57825a-71d1-4f7c-8eb9-4a25914a4084 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:11.096382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57825a-71d1-4f7c-8eb9-4a25914a4084 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:11.096507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57825a-71d1-4f7c-8eb9-4a25914a4084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:11.163468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4c57825a-71d1-4f7c-8eb9-4a25914a4084 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:40:11.164689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4c57825a-71d1-4f7c-8eb9-4a25914a4084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:11.263388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 754/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:40:11.303940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:40:11.305474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:11.412501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4e9c6-6466-4185-8c09-931659833316 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:40:11.488919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:40:11.489521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:40:11.489807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:40:11.490090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:40:11.491784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:40:11.500842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:11.599852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:40:11.601206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a41f7-7693-4b2a-a8d7-d975db12e1e8 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:40:11.619750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 739/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:40:21.261506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=82 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:40:21.617360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=50 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:39.447437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:39.448014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:39.448014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:39.522904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:41:39.524153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:39.620088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 755/1494] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:41:39.628555 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:39.629065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:39.629183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:39.703683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:41:39.705558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:39.803740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 740/1495] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:41:39.808788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:39.810000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:39.822254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09980104-24e9-46f1-a269-31feebd265a1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:39.883792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:39.917329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:39.917988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:39.918269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:39.918541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:39.919285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:41:39.919592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:39.920599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:39.920599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:41:39.920599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:41:39.921488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:39.933403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 756/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:41:39.941700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:39.950876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece64c-c0ac-4914-a095-0a41c42c64b1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:40.014494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:40.048521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:40.049176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.049455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.049727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.050427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:40.052248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:40.052248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:41:40.052248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:41:40.053461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:40.106897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 741/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:41:39 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:41:40.111948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:40.113468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:40.145992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acdcb0-142e-4794-bc87-f19c81394dc5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:40.241464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:40.242122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.242404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.242677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.243409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:40.244415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:40.244415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:41:40.244415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:41:40.245636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:40.285956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 757/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:41:40 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:41:40.290034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:40.291562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:40.355712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f3732-71cf-43c3-bc14-e044dd5212f0 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:40.437644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:40.450315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:40.450988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.451314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.451592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.452319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:40.453364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:40.453364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:41:40.453364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:41:40.454794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:40.467250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 742/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:41:40.472082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:40.473584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:40.485187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98623-bb07-44fe-8856-a82fc13027bc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:40.509896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:40.581653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:40.582601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.583030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.583347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.584073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:40.585521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:40.585521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:41:40.585521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:41:40.586427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dec85-a9a8-4dd9-ab55-f59fcbd68188 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:40.600249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 758/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:41:40.604689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:40.606243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:40.640656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463011-888a-46c4-9b6d-8de8663ea339 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:40.736136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:40.736948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.737231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.737510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] PATH_INFO: `/v3/projects/f8792db310414d92bfb14284909afe4d/users/3e035f18c51743b4881e1024c365c509/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.758994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8792db310414d92bfb14284909afe4d, user_id=3e035f18c51743b4881e1024c365c509, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:40.760067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:40.760067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:41:40.760067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:41:40.762025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03206fe-297c-408b-87c3-0f964b694736 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:40.786805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 743/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:41:40 2022] PUT /identity/v3/projects/f8792db310414d92bfb14284909afe4d/users/3e035f18c51743b4881e1024c365c509/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:41:40.799858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250c46-da65-4c70-9dec-8fe6e6b9510e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.800179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250c46-da65-4c70-9dec-8fe6e6b9510e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.800462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5250c46-da65-4c70-9dec-8fe6e6b9510e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.856095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e5250c46-da65-4c70-9dec-8fe6e6b9510e None None] MFA Rules not processed for user `3e035f18c51743b4881e1024c365c509`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:41:40.857303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e5250c46-da65-4c70-9dec-8fe6e6b9510e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:40.935358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 759/1502] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:41:40.948502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024971b-f826-4c96-a147-42263e435e41 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.948795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024971b-f826-4c96-a147-42263e435e41 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.949106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024971b-f826-4c96-a147-42263e435e41 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.950506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 744/1503] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 25 05:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:41:40.956351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c16-4326-4d93-afda-800f944b005e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:40.956641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c16-4326-4d93-afda-800f944b005e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:40.956918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565c16-4326-4d93-afda-800f944b005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:40.987419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.033013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4f565c16-4326-4d93-afda-800f944b005e None None] MFA Rules not processed for user `9e060788d6f54f4d9fcbccdb720c3500`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:41:41.034216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4f565c16-4326-4d93-afda-800f944b005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:41.112056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 760/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 25 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:41:41.119961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024971b-f826-4c96-a147-42263e435e41 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:41.121480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0024971b-f826-4c96-a147-42263e435e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:41.171427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.227014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024971b-f826-4c96-a147-42263e435e41 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:41.300214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:41.300783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:41.301062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:41.301337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:41.302954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:41.405046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:41.406493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:41.410581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.426021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 745/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:41:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:41:41.468231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc375-132f-4e78-b1b7-b5c304c51988 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:41.468913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc375-132f-4e78-b1b7-b5c304c51988 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:41.469253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc375-132f-4e78-b1b7-b5c304c51988 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:41.470705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 761/1506] 10.222.0.27 () {52 vars in 829 bytes} [Mon Jul 25 05:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:41:41.474599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:41.475929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:41.577642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9f6f4-aba1-4d05-925c-8e82c45910b5 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:41.791738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:41.792595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:41.792875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:41.793146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] PATH_INFO: `/v3/users/3e035f18c51743b4881e1024c365c509` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:41.806173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e035f18c51743b4881e1024c365c509)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:41.807215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:41.807215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:41:41.807215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:41:41.808431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:41.818345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:41.870705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e035f18c51743b4881e1024c365c509'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:41.871062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e035f18c51743b4881e1024c365c509'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:41.880014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e035f18c51743b4881e1024c365c509'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:41.892282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e035f18c51743b4881e1024c365c509'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:41.910449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e035f18c51743b4881e1024c365c509'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:41.916128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 746/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:41:41 2022] DELETE /identity/v3/users/3e035f18c51743b4881e1024c365c509 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:41:41.920531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:41.921006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:41.921107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:41.977217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:41:41.978434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:42.054229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:42.068409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 762/1508] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:41:42.077992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:42.080113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:42.180141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc24e9-bf16-4922-9a78-3369a2b49f06 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:42.234166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:42.255175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:42.255831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:42.256116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:42.256397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:42.258038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:42.367778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:42.369217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d25007-a7c6-4ed4-a8b1-94e1b5e7412e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:42.386704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 747/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:41:42.708453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:41:42.709765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:41:42.722180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea756a-a70f-4fb8-82d7-d0621d9dec05 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:41:42.819644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:41:42.820509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:41:42.820785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:41:42.821054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] PATH_INFO: `/v3/projects/f8792db310414d92bfb14284909afe4d` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:41:42.831511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8792db310414d92bfb14284909afe4d)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:41:42.832523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:41:42.832523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:41:42.832523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:41:42.833719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:41:42.890260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8792db310414d92bfb14284909afe4d', 'request_id': 'req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:42.900728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8792db310414d92bfb14284909afe4d', 'request_id': 'req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:42.906729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8792db310414d92bfb14284909afe4d', 'request_id': 'req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:42.935641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] The token cache is being invalidate because project f8792db310414d92bfb14284909afe4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:41:42.936267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:42.936457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-248f43e9-58c3-49f8-9dd7-c7beff8b7bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:41:42.937928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 763/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:41:42 2022] DELETE /identity/v3/projects/f8792db310414d92bfb14284909afe4d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:41:52.384446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=62 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:41:52.933622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:25.049869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:25.050387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:25.050571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:25.052036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:25.056972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1751-5d2b-45a9-b98d-7eb73af86720 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:25.057425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1751-5d2b-45a9-b98d-7eb73af86720 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:25.057531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da1751-5d2b-45a9-b98d-7eb73af86720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:25.140493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-59da1751-5d2b-45a9-b98d-7eb73af86720 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:25.141773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-59da1751-5d2b-45a9-b98d-7eb73af86720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:25.244631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:25.398479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:25.400718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:25.517400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62187b-475b-40b4-aeb4-256575a38fbe None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:25.523404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:25.524045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:25.524325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:25.524602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:25.533124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:25.534815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f139b3-81b8-4b9a-9162-0a0b38148745 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:25.544837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 749/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:26.380078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea43c-6a27-4c88-b142-aa6c2ea6d39b None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:26.380570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea43c-6a27-4c88-b142-aa6c2ea6d39b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:26.380678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea43c-6a27-4c88-b142-aa6c2ea6d39b None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:26.382130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:26.386926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed417f0-920b-4d9c-be7d-b35ace0e015a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:26.387375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed417f0-920b-4d9c-be7d-b35ace0e015a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:26.387509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed417f0-920b-4d9c-be7d-b35ace0e015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:26.405843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7ed417f0-920b-4d9c-be7d-b35ace0e015a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:26.407034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7ed417f0-920b-4d9c-be7d-b35ace0e015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:26.415403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:26.564657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea43c-6a27-4c88-b142-aa6c2ea6d39b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:26.579704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea43c-6a27-4c88-b142-aa6c2ea6d39b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:26.585889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:26.586526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:26.586814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:26.587097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:26.595307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:26.596899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb7592-ef3f-49d3-be83-82c94ff99ff4 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:26.606805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 766/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:27.436903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781fae-e142-484d-a863-1b59bcf45aa7 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:27.437481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781fae-e142-484d-a863-1b59bcf45aa7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:27.437481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d781fae-e142-484d-a863-1b59bcf45aa7 None None] PATH_INFO: `/v3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:27.438762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 751/1517] 10.222.0.48 () {54 vars in 925 bytes} [Mon Jul 25 05:43:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:43:27.445313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c9c4-6846-407d-bfb0-fe2f8ebea0e1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:27.445768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c9c4-6846-407d-bfb0-fe2f8ebea0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:27.445868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6c9c4-6846-407d-bfb0-fe2f8ebea0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:27.504004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0cb6c9c4-6846-407d-bfb0-fe2f8ebea0e1 None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:27.505122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0cb6c9c4-6846-407d-bfb0-fe2f8ebea0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:27.522051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:27.575653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 767/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:31.395235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2db52a-2b09-4064-9ddb-d45635ff147d None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:31.395706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2db52a-2b09-4064-9ddb-d45635ff147d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:31.395820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2db52a-2b09-4064-9ddb-d45635ff147d None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:31.397152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 752/1519] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 25 05:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:31.402319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c43c8-8e47-45f7-bbbd-bd780d60c9db None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:31.402768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c43c8-8e47-45f7-bbbd-bd780d60c9db None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:31.402876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c43c8-8e47-45f7-bbbd-bd780d60c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:31.420492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5d0c43c8-8e47-45f7-bbbd-bd780d60c9db None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:31.421677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5d0c43c8-8e47-45f7-bbbd-bd780d60c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:31.431110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 768/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 25 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:43:31.438789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2db52a-2b09-4064-9ddb-d45635ff147d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:31.452816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2db52a-2b09-4064-9ddb-d45635ff147d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:31.458110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:31.458745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:31.459026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:31.459346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:31.467484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:31.469092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b13b7-2315-4206-ac0d-358d1c1c0790 service placement] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:31.478756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 753/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:37.858541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894388-b489-4af6-bc67-f836c4e591f5 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:37.859084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894388-b489-4af6-bc67-f836c4e591f5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:37.859084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29894388-b489-4af6-bc67-f836c4e591f5 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:37.860521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:37.865993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64906cf-1953-4eac-88d4-329acb729ae0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:37.866384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64906cf-1953-4eac-88d4-329acb729ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:37.866539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64906cf-1953-4eac-88d4-329acb729ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:37.884140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e64906cf-1953-4eac-88d4-329acb729ae0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:37.885321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e64906cf-1953-4eac-88d4-329acb729ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:37.892956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:38.047375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894388-b489-4af6-bc67-f836c4e591f5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:38.062173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29894388-b489-4af6-bc67-f836c4e591f5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:38.067745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:38.068380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:38.068669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:38.068949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:38.076995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:38.078580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274498f-1695-4fc3-ae57-a5e7a9df16fc service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:38.088079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 770/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:38.897109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf29f-a76c-4001-9cbe-e6a6f32450cf None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:38.897674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf29f-a76c-4001-9cbe-e6a6f32450cf None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:38.897674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf29f-a76c-4001-9cbe-e6a6f32450cf None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:38.899066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 05:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:38.903779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b2e7-c165-430e-a9ff-40018a3bcb7f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:38.904205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b2e7-c165-430e-a9ff-40018a3bcb7f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:38.904319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b2e7-c165-430e-a9ff-40018a3bcb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:38.923024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-acd0b2e7-c165-430e-a9ff-40018a3bcb7f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:38.924500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-acd0b2e7-c165-430e-a9ff-40018a3bcb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:38.932811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:39.086263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf29f-a76c-4001-9cbe-e6a6f32450cf None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:39.101001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcf29f-a76c-4001-9cbe-e6a6f32450cf None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:39.106666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:39.107341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:39.107626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:39.107904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:39.116195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:39.117862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c7ca1-1693-4cd8-82ce-460084360cfe service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:39.127167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 756/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:43.146297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:43.146897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:43.146897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:43.148646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:43.153829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372240f-499e-49e6-9b19-c4058fb4c775 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:43.154292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372240f-499e-49e6-9b19-c4058fb4c775 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:43.154428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372240f-499e-49e6-9b19-c4058fb4c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:43.172081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1372240f-499e-49e6-9b19-c4058fb4c775 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:43.173281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1372240f-499e-49e6-9b19-c4058fb4c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:43.181656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:43.254423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:43.256156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:43.335545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae6846-0f42-48be-abab-642f90639dd4 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:43.339324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:43.339977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:43.340260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:43.340537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:43.349771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:43.351258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1c0d-335a-4a74-9be8-bb42026481b2 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:43.361563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 773/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:45.377242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee0d-87bf-43f9-b4e9-fe79dad636dd None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:45.377766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee0d-87bf-43f9-b4e9-fe79dad636dd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:45.377887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee0d-87bf-43f9-b4e9-fe79dad636dd None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:45.379262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:45.384430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a794d-7fb8-43dc-a0ec-f98815292006 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:45.384852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a794d-7fb8-43dc-a0ec-f98815292006 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:45.385023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a794d-7fb8-43dc-a0ec-f98815292006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:45.403426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-241a794d-7fb8-43dc-a0ec-f98815292006 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:45.404630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-241a794d-7fb8-43dc-a0ec-f98815292006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:45.412455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:43:45.449186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eee0d-87bf-43f9-b4e9-fe79dad636dd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:45.459705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eee0d-87bf-43f9-b4e9-fe79dad636dd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:45.464324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:45.464955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:45.465234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:45.465514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:45.481979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:45.483438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35f208-f795-4c53-a899-5d6f03d2facf service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:45.493136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 759/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:48.974396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:48.974964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:48.974964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:48.976355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:48.982544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488380-c036-46ba-9822-7c706a19d4e5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:48.982982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488380-c036-46ba-9822-7c706a19d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:48.983115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488380-c036-46ba-9822-7c706a19d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:49.001479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f9488380-c036-46ba-9822-7c706a19d4e5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:49.002679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f9488380-c036-46ba-9822-7c706a19d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:49.010606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:49.312087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:49.313775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:49.378688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:43:49.393120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290625f-99ea-45f2-ad57-71d6aae8209d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:49.396724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:49.397381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:49.397668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:49.397953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:49.407683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:49.409119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b152d2-26e0-4be3-af7e-394e79a4e8fc service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:49.418859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 776/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:43:51.486549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:51.487020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:51.487127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:51.488542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 05:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:43:51.494699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd2152-c97c-45d9-9319-8b01e7d8da19 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:51.495270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd2152-c97c-45d9-9319-8b01e7d8da19 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:51.495387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd2152-c97c-45d9-9319-8b01e7d8da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:51.513592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-32bd2152-c97c-45d9-9319-8b01e7d8da19 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:43:51.514712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-32bd2152-c97c-45d9-9319-8b01e7d8da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:51.522516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 05:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:43:51.822758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:43:51.824474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:43:51.838078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef719-a92a-42d8-812c-165bbe371775 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:43:51.841628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:43:51.842262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:43:51.842546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:43:51.842825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:43:51.851845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:43:51.853265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4664b-6b2f-42ea-b79c-b6131d7d4e31 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:43:51.862865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 762/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:44:01.508886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=11 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:44:01.858699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:23.545688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.546337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.546337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.581161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:23.582443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:23.594378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 778/1540] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:23.603322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.604414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.604414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.632158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:23.633838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:23.645856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 763/1541] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:23.651048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:23.662989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437ddb-b547-46ad-9c23-25e1c1c53cdb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:23.672948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:23.673639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.673919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.674194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.675070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:23.675548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:23.677481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:23.699441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 779/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:23.707945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:23.722473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9a2d8-cf58-4984-b9d7-230cec54ec8b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:23.731739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:23.732976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.733268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.733550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.734287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:23.736243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:23.787160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 764/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:23 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:23.792311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:23.809395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda168-6f14-4d4f-a10c-84a0a0f4a5bf admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:23.891171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:23.891804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.892068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.892345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.893050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:23.895061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:23.926933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 780/1544] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:23 2022] POST /identity/v3/users => generated 303 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:23.931830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:23.948038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f1c33-7a08-414a-97b6-54c913d38c28 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:23.955969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:23.956660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:23.956944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:23.957223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:23.957961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:23.959631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:23.977833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 765/1545] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:23.981600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.002880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97bed0-3eef-48de-9610-01e4f5199a55 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.012640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.013405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.013679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.013960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.014750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.016552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2c0c-83c0-48db-8e08-d557c8875250 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.033073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 781/1546] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:24.037406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.053257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7498-cd1b-4399-9b27-f4abdc54f10c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.068115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.069048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.069335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.070502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] PATH_INFO: `/v3/projects/0b921006ce0c4f24aea27f448f7be347/users/fc93739dde4347b6af1d238a6c299299/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.089135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019020-b299-45a1-bf26-711d3326a726 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.089469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019020-b299-45a1-bf26-711d3326a726 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.089694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019020-b299-45a1-bf26-711d3326a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.095025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b921006ce0c4f24aea27f448f7be347, user_id=fc93739dde4347b6af1d238a6c299299, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.098104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681b132-8105-45e5-a2fc-669e5f3f1874 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.121991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ea019020-b299-45a1-bf26-711d3326a726 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.123385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ea019020-b299-45a1-bf26-711d3326a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.125692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 766/1547] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:24 2022] PUT /identity/v3/projects/0b921006ce0c4f24aea27f448f7be347/users/fc93739dde4347b6af1d238a6c299299/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:24.181590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c5c-01de-4112-a443-1851e458c3a0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.181786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c5c-01de-4112-a443-1851e458c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.182378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c5c-01de-4112-a443-1851e458c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.225630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 782/1548] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:24.233256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-61a90c5c-01de-4112-a443-1851e458c3a0 None None] MFA Rules not processed for user `fc93739dde4347b6af1d238a6c299299`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.234439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a63c-93a9-48a0-91e7-622bd4c81c2c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.234575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-61a90c5c-01de-4112-a443-1851e458c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.234768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a63c-93a9-48a0-91e7-622bd4c81c2c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.235000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a63c-93a9-48a0-91e7-622bd4c81c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.264930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-aa40a63c-93a9-48a0-91e7-622bd4c81c2c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.266139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-aa40a63c-93a9-48a0-91e7-622bd4c81c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.293777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 783/1549] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:24.295335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.295607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.295888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.331084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.335240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.354803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 784/1550] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.356039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.377412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a4d22-ae03-4efa-b98c-de46ab24c797 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.388877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.389566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.389961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.390244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.390978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.395438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.397088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8109-73d0-4c18-8a23-79599aa6a797 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.419589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 767/1551] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:24.420947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.421371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.421499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 785/1552] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.422571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.422861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.423156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.423883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.456314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.457440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.464035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.465695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.474709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 786/1553] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.479157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.480958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 768/1554] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.481887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.494811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cd311-b95e-4e17-bdc7-10038b1f0b7b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.497562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b99265-0262-4a71-b96f-fb2e4b54c198 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.499775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.500408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.500693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.500969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.501699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.502329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.503089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.503400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.503632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92d1a-de67-4821-828a-2d02582f3032 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.503748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.504353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.505360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:24.505360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:45:24.505360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:45:24.506550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5558768-c99d-4b04-8e2e-b39d9e3b3e97 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.530691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 769/1555] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:24.532175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.532462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.532742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.539750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 787/1556] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:24.539750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e38c-855d-4aa4-bf8c-f7a7278baa7a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.539750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e38c-855d-4aa4-bf8c-f7a7278baa7a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.539750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e38c-855d-4aa4-bf8c-f7a7278baa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.548039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:24.552201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.553432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.560228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a048e38c-855d-4aa4-bf8c-f7a7278baa7a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.561613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a048e38c-855d-4aa4-bf8c-f7a7278baa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.597646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:24.614847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 770/1557] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.615726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.626426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 788/1558] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.627976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3b24-1d01-4eea-8cca-45d716c3de59 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.628269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3b24-1d01-4eea-8cca-45d716c3de59 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.628556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3b24-1d01-4eea-8cca-45d716c3de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.632003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208bdd9-d6bb-49df-9d61-d9020c5831a5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.637757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.638427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.638708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.638984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.639759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.640068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.641090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:24.641090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:45:24.641090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:45:24.642010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231f54d-4784-4859-b02f-996417364179 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.649129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b3bb3b24-1d01-4eea-8cca-45d716c3de59 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.650418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b3bb3b24-1d01-4eea-8cca-45d716c3de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.654589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 771/1559] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.658468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.658761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.659037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.663265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 789/1560] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.665102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b869-730c-404e-a167-9889719235e3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.665640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b869-730c-404e-a167-9889719235e3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.665989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b869-730c-404e-a167-9889719235e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.677099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.678322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.684214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-eb78b869-730c-404e-a167-9889719235e3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.685451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-eb78b869-730c-404e-a167-9889719235e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.686381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 772/1561] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.687210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.702064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 790/1562] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.702064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78b869-730c-404e-a167-9889719235e3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.702329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ee30-c6b5-4a4f-8c35-8699890e8243 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.702329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.702329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.702573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.702657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.703377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.704385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:24.704385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:45:24.704385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:45:24.705584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1804c-e8fc-4a5d-af01-64a42c7cfe85 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.706745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78b869-730c-404e-a167-9889719235e3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.712181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.713045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.713335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.713622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.714316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.716526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f91700-e84e-46fc-aedf-ac6198e67156 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.727120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 773/1563] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:24.728518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.728806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.729086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.740724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 791/1564] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/users => generated 308 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:24.742140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e5e9-9f31-47e8-a004-b83e3eda1bce None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.742572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e5e9-9f31-47e8-a004-b83e3eda1bce None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.743038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e5e9-9f31-47e8-a004-b83e3eda1bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.748143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.749340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.757898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 774/1565] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.759232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.761017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5f96e5e9-9f31-47e8-a004-b83e3eda1bce None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.762330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5f96e5e9-9f31-47e8-a004-b83e3eda1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.770798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d37b-b578-4dc7-92ff-390eb515789b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.775210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 792/1566] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.775210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.775210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.775210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.778913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.779608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.779892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.780169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.780859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.782792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b45fe-5f85-4201-94cb-08300b438602 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.791777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.792955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.801074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 793/1567] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.801928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.811490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 775/1568] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:24.811490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.811490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.811490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.814476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadbd7-f12b-41fb-acab-7c1a002ccb0f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.828459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:24.829661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:24.872199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.872866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.873149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.873423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.874150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.874456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.876104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.888417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 794/1569] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.888585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 776/1570] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:24.888935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.889404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.898997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93c2b1-73d1-4eb9-9151-3c789e74107f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.900621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e78c9-4296-4cf7-99d0-5e5a443c566e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.903659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.904315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.904603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.904879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.905222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.905596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.905872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.906150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.906430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.907175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.907302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.908745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.918082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 795/1571] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:24.918943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.920192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 777/1572] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:24.921202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.931611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb34f-4789-49b4-8b36-141fd0bbd441 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.935611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d31f7e-9ac7-4378-972b-f252e87f9ec6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.936351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.937000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.937278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.937554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.938271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.938578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.940206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.940353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.940976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.941260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.941539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.942253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.942556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.944165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.952452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 796/1573] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.953320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.963394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78d4a-64c3-4a05-8fd0-6627b6de445c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.963608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 778/1574] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.964568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:24.973195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.973844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.974128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.974350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf441f4-e53c-4892-9bf1-950945a79d32 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:24.974458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.975160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:24.975477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.977097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.978942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:24.979614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:24.979893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:24.980165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:24.981230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:24.983148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:24.989724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 797/1575] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:24.990573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.001910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820445f-03cf-4307-911e-e700df72eb37 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.006579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.007282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.008180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.008456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.009139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.009844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 779/1576] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.010539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.011229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.020412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea896-2dd4-4218-9a4b-7d84fbe5784d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.025461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.025645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.026463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.026809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.027358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.028403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:25.028774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.031368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.043751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 798/1577] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:24 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.043751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.052037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 780/1578] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:25.052037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.057039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abb48f-49d3-42af-821c-8ebab5bbab44 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.084791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.114134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef00aa-9354-40c8-bdc7-345722c94493 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.117487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.118389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.118669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.118949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] PATH_INFO: `/v3/projects/e3f5954bf4504d65b521f3d63c700f9d/users/bd25d9df6791455883b188f5029337f9/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.119388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.120061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.120345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.120622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.121346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.122964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.133999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 799/1579] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.134194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f5954bf4504d65b521f3d63c700f9d, user_id=bd25d9df6791455883b188f5029337f9, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.135033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.136823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.145126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1795307-8f97-4d43-81cc-21d1763c3f45 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.150332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 781/1580] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:25 2022] PUT /identity/v3/projects/e3f5954bf4504d65b521f3d63c700f9d/users/bd25d9df6791455883b188f5029337f9/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:25.151117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.203003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.203699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.203988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.204320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.205186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.207184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.210316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa264b-a905-4798-aa1a-83bc78c3e430 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.216191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.216808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.217092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.217435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.218126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.220081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.233939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 800/1581] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.234688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.247427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 782/1582] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.248465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.297556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e464d-320f-4b0a-8e00-4ab5a4a68faf admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.311832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbd2ae-b782-4a63-9570-5002f3062dfe admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.316854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.317525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.317805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.318107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.318789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.321010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.322489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.332119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 783/1583] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.333229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.343917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184fe6-cc14-4d12-af88-64b822cd30f7 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.349819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.350519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.350803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.351157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.352126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.354052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.363610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.364304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.364588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.364862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.365549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.367762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.375166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 784/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.376114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.388315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc361f64-8a8c-4581-af37-f907e2361629 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.393100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.393746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.394025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.394300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.398794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.398947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 801/1585] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.398947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.399159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.411987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.429647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 785/1586] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.430668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.460167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc3a7-3fee-40fe-b303-39ac16925658 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.492658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afd97b-adda-4a24-a8c8-9383c72eab43 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.497181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.497842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.498121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.498393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.499118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.500730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.511055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 786/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.511862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.520928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58d06-3bd2-431b-90ed-7fa7cd1d575b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.521149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.522049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.522359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.522657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] PATH_INFO: `/v3/projects/187803eee85f47d0bc6e0636016dc1be/users/800fc86b092746b0a819b0adbf75f7bb/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.526183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.526821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.527100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.527404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.528074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.529965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.538520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187803eee85f47d0bc6e0636016dc1be, user_id=800fc86b092746b0a819b0adbf75f7bb, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.539995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:25.539995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:45:25.539995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:45:25.542334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.549715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 787/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/users => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.550469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.559300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 802/1589] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:25 2022] PUT /identity/v3/projects/187803eee85f47d0bc6e0636016dc1be/users/800fc86b092746b0a819b0adbf75f7bb/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:25.560253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.567643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dc2b0-314d-467b-8a70-00b7cb2878d2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.603709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.625267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa96f-44ef-4d9d-a5c1-84a717571351 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.626774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.627486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.627775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.628057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.628749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.629938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.630631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.630760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.630908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.631216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.631937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.634159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.644069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 803/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.644927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.652418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 788/1591] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.653105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.654974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65176fd3-712b-41e7-bb4e-ba868bc52130 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.659642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.660346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.660632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.660906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.661624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.662782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2b32e-90b2-4aaf-b1ca-3c9e9fdba208 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.663234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.669198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.669843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.670122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.670396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.671070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.672994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.673693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 804/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.674472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.684608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278b44-b743-4472-8701-4c68cf95ed95 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.689815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.690615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.691007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.691414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.692206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.694434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.702475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 789/1593] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.702475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.711869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b72e40-88cb-4db4-983a-6e22041f3c03 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.715009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 805/1594] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:25.716016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.719541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.720425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.720715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.720976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] PATH_INFO: `/v3/projects/e3f5954bf4504d65b521f3d63c700f9d/users/bd25d9df6791455883b188f5029337f9/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.722932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f5954bf4504d65b521f3d63c700f9d, user_id=bd25d9df6791455883b188f5029337f9, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.725578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3c5cf-4e03-4521-8df4-d93d94119dcf admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.725704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07660-d61c-4469-8d2d-3ab4294f5f10 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.730320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.731256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.731549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.731828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.732546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.734142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.737168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 790/1595] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:25 2022] PUT /identity/v3/projects/e3f5954bf4504d65b521f3d63c700f9d/users/bd25d9df6791455883b188f5029337f9/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:25.746775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.746775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.746775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.752525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 806/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.753256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.763673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79246f4-6fe2-4375-ad1b-2d7f2df84da1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.765427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] MFA Rules not processed for user `800fc86b092746b0a819b0adbf75f7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:25.766623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:25.787512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.825400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.826402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.826694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.826969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] PATH_INFO: `/v3/projects/71a39d9cebe34c86b7cf6899f4cb483a/users/268380d74d1846798174e7c3539dcb1f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.838285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 791/1597] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:25.839163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.845259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a39d9cebe34c86b7cf6899f4cb483a, user_id=268380d74d1846798174e7c3539dcb1f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.848019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.849064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb864c4-5d5d-4da9-a37c-883dd21ab4bf None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.853987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.854644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.854927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.855234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.856231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.857969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.862368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 807/1598] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:25 2022] PUT /identity/v3/projects/71a39d9cebe34c86b7cf6899f4cb483a/users/268380d74d1846798174e7c3539dcb1f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:25.866667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.872106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 792/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.872106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.879373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa38ac-4baa-427a-99d6-6a6c840b8e04 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.930163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f926b-5acb-47f2-b33d-508ed8392a18 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.934831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.936044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.936190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.936392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.936665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.936774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.936971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.937245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.937391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.937963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.938997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.939593 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55a32d-6026-49e1-ad20-4bd257ae060f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.949682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 808/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.949925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 793/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.950765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.951170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66e13-cf6c-4db0-aaf8-069175ecd0f2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.951445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66e13-cf6c-4db0-aaf8-069175ecd0f2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.951721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66e13-cf6c-4db0-aaf8-069175ecd0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.964344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058795a-83db-48b7-a50b-3bae1262a352 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:25.969104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:25.969759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:25.970041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:25.970318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:25.971039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:25.972674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:25.977496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a5f66e13-cf6c-4db0-aaf8-069175ecd0f2 None None] MFA Rules not processed for user `bd25d9df6791455883b188f5029337f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:25.979188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a5f66e13-cf6c-4db0-aaf8-069175ecd0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:25.985785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 809/1602] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:25.985785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:25.989903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:25.995111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea2d1-9e5d-49b4-8930-dd9b8418f631 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.001329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.001900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.002183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.002462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.003205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.004828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.015493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 810/1603] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:26.016348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.026738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9332-d1e0-4a6e-9c91-7dade79c1571 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.031569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.032255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.032539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.032812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.033493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.035412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.052712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 794/1604] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:26.054101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.054459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.054843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.068847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 811/1605] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:26.068847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.074339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:26.075675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:26.101971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:26.136169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 795/1606] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:26.139614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.146342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6fb6-018d-4595-a852-64006775bc9a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.151372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58cea-539a-4b8c-a104-eef4c74e92e4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.152235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.153127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.153537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.153838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] PATH_INFO: `/v3/projects/2053c40acd5f458991d7ea902bced1ba/users/e8fb9b236e49474a83410309279bf4d6/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.156495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.157189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.157465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.157754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.158462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.160084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.169231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2053c40acd5f458991d7ea902bced1ba, user_id=e8fb9b236e49474a83410309279bf4d6, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.170811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 812/1607] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:26.171661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.172013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.181761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162faa51-325a-4f6c-9a6e-3d5b3d8754b0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.186414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 796/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:26 2022] PUT /identity/v3/projects/2053c40acd5f458991d7ea902bced1ba/users/e8fb9b236e49474a83410309279bf4d6/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:26.187388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.255384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.255973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.256266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362953aa-4dd9-475c-83b2-8ec792c50b74 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.256398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.256572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.257293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.259519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.261482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.262144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.262426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.262697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.263442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.265019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.269743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 813/1609] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:26.270662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.275967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 797/1610] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:26.276705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.281336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e7d13-a99f-4f56-97c2-f4298cdfee24 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.285974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.286844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.287125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.287430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] PATH_INFO: `/v3/projects/959f0811efef434b97dca3bf5fb1a071/users/b755c5dbee064673b16b29466f308e1f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.303903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] RBAC: Authorizing `identity:create_grant(project_id=959f0811efef434b97dca3bf5fb1a071, user_id=b755c5dbee064673b16b29466f308e1f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.306771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.321005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 814/1611] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:26 2022] PUT /identity/v3/projects/959f0811efef434b97dca3bf5fb1a071/users/b755c5dbee064673b16b29466f308e1f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:26.321906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.334030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475892e-9805-421d-956a-75a8c6297186 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.365478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:26.386344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc61db-d8b5-444d-b670-171ced1f414b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.389301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.389953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.390251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.390537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.391158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.391853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.392135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.392409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.393096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.395022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.403122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:26.418404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 815/1612] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:26.419402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.456337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.457774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.467720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 798/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:26.468487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.476869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8ae9-a7f7-4773-9c34-a098e95afa65 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.478367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283deba1-eac2-4835-85b3-d31dca29ff21 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.480907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.481560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.481840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.482151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.483381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.484332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.484673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.485071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] PATH_INFO: `/v3/projects/8da3c252b474448e86f2949ceac1748b/users/74dfeef7e3904ad684005ab59d48923f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.492399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.494310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a3600-ca7e-47f7-994e-87f324f094dd service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.505279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da3c252b474448e86f2949ceac1748b, user_id=74dfeef7e3904ad684005ab59d48923f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.509149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.510013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 816/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:26.511660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.512075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.512740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.536006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 799/1615] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:26 2022] PUT /identity/v3/projects/8da3c252b474448e86f2949ceac1748b/users/74dfeef7e3904ad684005ab59d48923f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:26.536006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.541413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] MFA Rules not processed for user `e8fb9b236e49474a83410309279bf4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:26.542384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:26.636197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169632f7-b679-402a-93f5-41e5965f172f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.645734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 817/1616] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:26.651303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.651529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.651690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.651690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.651690 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] PATH_INFO: `/v3/projects/9089d053721d4eae9705edf3b0910771/users/7c8067d2568e4ec1a9f2824d55922cd6/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.665893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd37f-a8a2-42ca-8a1e-b69a20dc18ca None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.668265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9089d053721d4eae9705edf3b0910771, user_id=7c8067d2568e4ec1a9f2824d55922cd6, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.671358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0aff-6557-412f-b483-0b17407cd595 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.671986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.672907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.673194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.673677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] PATH_INFO: `/v3/projects/58f41acfb11444ff9ccc46d9e083f29c/users/e44fe6b102c54a25ae59b407419b47cd/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.696867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 800/1617] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:26 2022] PUT /identity/v3/projects/9089d053721d4eae9705edf3b0910771/users/7c8067d2568e4ec1a9f2824d55922cd6/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:26.696867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d9d7-5cb0-4e3a-b193-1152d21e5660 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.696867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d9d7-5cb0-4e3a-b193-1152d21e5660 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.696867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51d9d7-5cb0-4e3a-b193-1152d21e5660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.700599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f41acfb11444ff9ccc46d9e083f29c, user_id=e44fe6b102c54a25ae59b407419b47cd, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.704366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.728301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 818/1618] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:26 2022] PUT /identity/v3/projects/58f41acfb11444ff9ccc46d9e083f29c/users/e44fe6b102c54a25ae59b407419b47cd/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:26.728625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.731316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9c51d9d7-5cb0-4e3a-b193-1152d21e5660 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:26.732801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9c51d9d7-5cb0-4e3a-b193-1152d21e5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:26.795924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:26.812053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 801/1619] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:26.813508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7febb4-2667-42fe-884a-d7bd7bf6e2ff None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.813797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7febb4-2667-42fe-884a-d7bd7bf6e2ff None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.814070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7febb4-2667-42fe-884a-d7bd7bf6e2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.830855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3bc4-d15c-4d97-9be1-86c5fbeb61a5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.839353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:26.840166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.841870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.842164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.842438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.843286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:26.846772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:26.856716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ce7febb4-2667-42fe-884a-d7bd7bf6e2ff None None] MFA Rules not processed for user `74dfeef7e3904ad684005ab59d48923f`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:26.858300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ce7febb4-2667-42fe-884a-d7bd7bf6e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:26.859005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 819/1620] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:26.859890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:26.935667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5af2fe-f965-4724-a7f6-2c5834054f33 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:26.939921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:26.940723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.941114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.941463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.956490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 802/1621] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:26.959049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867940f-25a6-463d-a366-ae8185b0f865 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:26.959364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867940f-25a6-463d-a366-ae8185b0f865 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:26.959644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867940f-25a6-463d-a366-ae8185b0f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:26.995587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5867940f-25a6-463d-a366-ae8185b0f865 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:26.996826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5867940f-25a6-463d-a366-ae8185b0f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.021873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 803/1622] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:27.024137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.024433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.024720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.052967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.055202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.066859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] MFA Rules not processed for user `e44fe6b102c54a25ae59b407419b47cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:27.068108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.072316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 820/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:27.073004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.089697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c5acf-3f7b-4f7e-9f50-a367989a83b8 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.104324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.105226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.105764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.106051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] PATH_INFO: `/v3/users/fc93739dde4347b6af1d238a6c299299` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.108459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc93739dde4347b6af1d238a6c299299)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.109419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: WARNING py.warnings [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:27.109419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: warnings.warn(msg) Jul 25 05:45:27.109419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: Jul 25 05:45:27.110762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.184928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 804/1624] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:27.184928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.187860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.209616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc93739dde4347b6af1d238a6c299299'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:27.223577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc93739dde4347b6af1d238a6c299299'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:27.277272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc93739dde4347b6af1d238a6c299299'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:27.278181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc93739dde4347b6af1d238a6c299299'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:27.291929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc93739dde4347b6af1d238a6c299299'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:27.294360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:27.303792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 821/1625] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:27 2022] DELETE /identity/v3/users/fc93739dde4347b6af1d238a6c299299 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:27.305275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.310499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.312311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f990e9-4c09-4f48-b33a-25a9f7f73978 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.368266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:27.404024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.404626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.405009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.405170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.408806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.433343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a1832-3acb-4681-8b2d-b66dc3ddfb3c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.439246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.442495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.443226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.443226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] PATH_INFO: `/v3/projects/02ca5427e4684adc82fab1360509986f/users/d39e7d09822c422c878278162f723936/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.462159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ca5427e4684adc82fab1360509986f, user_id=d39e7d09822c422c878278162f723936, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.465064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922dcef-0d72-4302-923c-be913f9ff8aa admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.488213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 822/1626] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:27 2022] PUT /identity/v3/projects/02ca5427e4684adc82fab1360509986f/users/d39e7d09822c422c878278162f723936/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:27.488213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.488213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.488213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.489634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 823/1627] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 05:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:27.490774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.492913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.532541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.538277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.560289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 805/1628] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:27.560968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.562369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.581203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920230e-435d-47cf-971b-115054e663ab service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.612084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e6b5-83fe-4a06-81ab-a1769343859e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.622493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.625005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.625487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.626446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.636733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.664548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.665763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.666051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.667999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.669982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.675353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f1ec6-3354-4b2a-8d55-39b934d99b5c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.722729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.725104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.740653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 824/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:27.740843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 806/1630] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:27 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:27.742157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce94b-9ebc-47e0-89e5-f42712ff5bc0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.742443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce94b-9ebc-47e0-89e5-f42712ff5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.742772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce94b-9ebc-47e0-89e5-f42712ff5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.743270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.761070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb98a3-2c12-444c-aa08-e28c8d599472 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.785070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-42cce94b-9ebc-47e0-89e5-f42712ff5bc0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:27.785504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-42cce94b-9ebc-47e0-89e5-f42712ff5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:27.807983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:27.877347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.878422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.879655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.880876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.881885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.884134 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.907378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 807/1631] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:27.910255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.910556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 825/1632] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:27.911454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.912305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.912515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:27.948737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58eb7-129e-47f2-a4e8-9b601aaf2a13 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:27.965924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:27.970881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:27.972044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:27.972434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:27.974982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:27.982026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:27.987122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:28.026577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:28.028330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:28.053904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 826/1633] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:27 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:28.054895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.079220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee858-c309-44ae-9c1a-70da0faf2add admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:28.094185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:28.095105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.095417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.095697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] PATH_INFO: `/v3/projects/02ca5427e4684adc82fab1360509986f/users/d39e7d09822c422c878278162f723936/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.101756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ca5427e4684adc82fab1360509986f, user_id=d39e7d09822c422c878278162f723936, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:28.104616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:28.146794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 827/1634] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:28 2022] PUT /identity/v3/projects/02ca5427e4684adc82fab1360509986f/users/d39e7d09822c422c878278162f723936/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:28.146794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.146794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:28.193428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 808/1635] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 05:45:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:28.196741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.233488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acc103-9c38-4019-aed3-adfdff9884af None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:28.354238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277d824-2293-48de-afb8-89ee87560b9b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:28.358959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:28.359761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.360103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.360451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.450869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:28.451633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.451914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.452728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.453490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:28.461113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c3e12-112a-449e-a206-78790339fe42 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:28.489526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 809/1636] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:28.495153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.495531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.495724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.523774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:28.530830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:28.559112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 828/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:28.562455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.563335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] MFA Rules not processed for user `d39e7d09822c422c878278162f723936`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:28.564899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:28.690828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:28.736644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca11b8-f0d8-4fa7-927a-f10095f1dccb service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:28.746962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 810/1638] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:28.747625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.748980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:28.749678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.750432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.750775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.760465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:28.786654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541648d-5198-4c92-82ab-43167f8a6fd0 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:28.797278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:28.798856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:28.798856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:28.798856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] PATH_INFO: `/v3/projects/c4960477659247ffb14176dee2481cea/users/beb9a8bb18384c828d8eb16b997c5bab/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:28.833324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:28.848404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4960477659247ffb14176dee2481cea, user_id=beb9a8bb18384c828d8eb16b997c5bab, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:28.854717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:28.888229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 811/1639] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:28 2022] PUT /identity/v3/projects/c4960477659247ffb14176dee2481cea/users/beb9a8bb18384c828d8eb16b997c5bab/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:28.892194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.895684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:28.895977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:28.904772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:28.935186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 829/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:28.936972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:28.951848 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a659fc-3310-43c1-9b28-0db6274c193c service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:29.013399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c486e0-ea3a-42b6-943c-6aaa4e299f4a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:29.146313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:29.146313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.146313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.146313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.156837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:29.158573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.158573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.158573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.158901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:29.160896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:29.209411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:29.212576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b7dcd-4d03-41d4-9cb8-9952fc57a6e5 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:29.215855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 830/1641] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:29.219439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:29.256359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5646-c042-4bdb-8d62-09ecbe197f9c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:29.261855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 812/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:29.276372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:29.277299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.277587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.277873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] PATH_INFO: `/v3/projects/c4960477659247ffb14176dee2481cea/users/beb9a8bb18384c828d8eb16b997c5bab/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.285626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4960477659247ffb14176dee2481cea, user_id=beb9a8bb18384c828d8eb16b997c5bab, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:29.287980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5e90-85c7-45b1-adaf-4d7fd494620a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:29.324857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 831/1643] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:29 2022] PUT /identity/v3/projects/c4960477659247ffb14176dee2481cea/users/beb9a8bb18384c828d8eb16b997c5bab/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:29.341002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.341401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.341787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.420328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] MFA Rules not processed for user `beb9a8bb18384c828d8eb16b997c5bab`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:29.421792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:29.494986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bf70f-5c6b-4c93-83ca-2c5ab1be34fc None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.495411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bf70f-5c6b-4c93-83ca-2c5ab1be34fc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.495884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bf70f-5c6b-4c93-83ca-2c5ab1be34fc None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.501064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 832/1644] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 05:45:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:29.507206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d882c-f95e-453d-85af-669742de203d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.508180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d882c-f95e-453d-85af-669742de203d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.508618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d882c-f95e-453d-85af-669742de203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.548898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f95d882c-f95e-453d-85af-669742de203d None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:29.553400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f95d882c-f95e-453d-85af-669742de203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:29.713103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:29.746391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 833/1645] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:29.747846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d882c-f95e-453d-85af-669742de203d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:29.749697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 813/1646] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:29.753880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f95d882c-f95e-453d-85af-669742de203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:29.756791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:29.848447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d882c-f95e-453d-85af-669742de203d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:29.857280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:29.861232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:29.862312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:29.864655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:29.865228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] PATH_INFO: `/v3/projects/0b921006ce0c4f24aea27f448f7be347` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:29.867936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b921006ce0c4f24aea27f448f7be347)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:29.874208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:29.949485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238c38d-4c4e-453a-a931-21f864f028ef None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:29.974798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b921006ce0c4f24aea27f448f7be347', 'request_id': 'req-ba151611-0709-4aff-9847-9d05323e6d3d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:29.994065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b921006ce0c4f24aea27f448f7be347', 'request_id': 'req-ba151611-0709-4aff-9847-9d05323e6d3d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.004920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b921006ce0c4f24aea27f448f7be347', 'request_id': 'req-ba151611-0709-4aff-9847-9d05323e6d3d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.035587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] The token cache is being invalidate because project 0b921006ce0c4f24aea27f448f7be347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:30.035873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.037625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.042722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 834/1647] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:29 2022] DELETE /identity/v3/projects/0b921006ce0c4f24aea27f448f7be347 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:30.044141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:30.049313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.084794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:30.086620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.088601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.088896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.095568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.193390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba151611-0709-4aff-9847-9d05323e6d3d admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:30.201850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:30.203524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.203811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.204091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.208493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.264393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:30.269384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:30.300009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 814/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:45:30.300953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:30.306145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.316356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:30.362132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:30.363630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddefa-a951-42fd-913c-942dde5e5d7d service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:30.388981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 835/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:30.390523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4cb8-5f34-41df-bf26-a7d721068268 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.390822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4cb8-5f34-41df-bf26-a7d721068268 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.391100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4cb8-5f34-41df-bf26-a7d721068268 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.392738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 836/1650] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 05:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:30.400072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c0fc-3050-4be1-9ba3-99b51519724e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.400504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c0fc-3050-4be1-9ba3-99b51519724e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.400928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678c0fc-3050-4be1-9ba3-99b51519724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.444256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1678c0fc-3050-4be1-9ba3-99b51519724e None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:30.445960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1678c0fc-3050-4be1-9ba3-99b51519724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.468424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62906-1d30-43f7-a90c-6c8b60ed5a4d service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:30.468790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 837/1651] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 05:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:30.474781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386875fc-20e0-4dc2-ab17-b1e691eb51de None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.476098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386875fc-20e0-4dc2-ab17-b1e691eb51de None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.477582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386875fc-20e0-4dc2-ab17-b1e691eb51de None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.481235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 838/1652] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 05:45:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:30.483087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:30.486161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.486517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.486756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.487103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.487521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.488939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] PATH_INFO: `/v3/users/bd25d9df6791455883b188f5029337f9` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.490705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd25d9df6791455883b188f5029337f9)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:30.495243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:30.541545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:30.545007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.571873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:30.576765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 839/1653] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:30.633886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd25d9df6791455883b188f5029337f9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.637143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd25d9df6791455883b188f5029337f9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.653643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd25d9df6791455883b188f5029337f9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.668279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd25d9df6791455883b188f5029337f9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.680268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:30.698571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6fdd2-5ca2-48f7-8191-6c270b81e01d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:30.705903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd25d9df6791455883b188f5029337f9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:30.713096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:30.713619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.716244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.716749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.720967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.728736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 815/1654] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:30 2022] DELETE /identity/v3/users/bd25d9df6791455883b188f5029337f9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:30.745220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:30.746668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:30.761818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 840/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:30.852054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:30.854261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:30.949529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e015-2a8e-4f4d-999e-2f9ca6a6a842 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:30.953788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:30.954513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:30.954807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:30.955083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:30.958201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:31.045657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:31.047297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5fc58-1574-434a-b2b7-05ff760447be service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:31.074725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 816/1656] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:31.867539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:31.869900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:31.895173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8a122-809a-4ee0-8866-d9666254f3eb service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:32.020281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:32.021566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:32.021675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:32.022223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] PATH_INFO: `/v3/users/800fc86b092746b0a819b0adbf75f7bb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:32.025506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800fc86b092746b0a819b0adbf75f7bb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:32.029143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:32.133671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800fc86b092746b0a819b0adbf75f7bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.159817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800fc86b092746b0a819b0adbf75f7bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.201890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800fc86b092746b0a819b0adbf75f7bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.202730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800fc86b092746b0a819b0adbf75f7bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.213365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800fc86b092746b0a819b0adbf75f7bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.227214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 841/1657] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:31 2022] DELETE /identity/v3/users/800fc86b092746b0a819b0adbf75f7bb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:32.229699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:32.230221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:32.230221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:32.265027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:32.266791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:32.459630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:32.461116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:32.473547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:32.518365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 817/1658] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:32.535324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:32.575907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2c7b-d4be-41c3-a953-13fe7c4800e4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:32.582202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:32.583224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:32.585980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:32.586682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:32.595969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:32.596987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] PATH_INFO: `/v3/projects/e3f5954bf4504d65b521f3d63c700f9d` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:32.600283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f5954bf4504d65b521f3d63c700f9d)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:32.609621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:32.734582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f5954bf4504d65b521f3d63c700f9d', 'request_id': 'req-886e25f1-9d8e-4d06-b8f1-627b51a893d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.771952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f5954bf4504d65b521f3d63c700f9d', 'request_id': 'req-886e25f1-9d8e-4d06-b8f1-627b51a893d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.772604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1831b7-129d-49de-8ec6-102b178cc0f7 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:32.783002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f5954bf4504d65b521f3d63c700f9d', 'request_id': 'req-886e25f1-9d8e-4d06-b8f1-627b51a893d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.822690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] The token cache is being invalidate because project e3f5954bf4504d65b521f3d63c700f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:32.823046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.824748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-886e25f1-9d8e-4d06-b8f1-627b51a893d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:32.828052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 842/1659] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:32 2022] DELETE /identity/v3/projects/e3f5954bf4504d65b521f3d63c700f9d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:32.834079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9069-0d97-412d-a2df-b4386725979e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:32.834400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9069-0d97-412d-a2df-b4386725979e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:32.834649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9069-0d97-412d-a2df-b4386725979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:32.859004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:32.860519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:32.861164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:32.861663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:32.875851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:32.908431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-061d9069-0d97-412d-a2df-b4386725979e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:32.910208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-061d9069-0d97-412d-a2df-b4386725979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:33.046902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.048527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.057828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 843/1660] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:33.061748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 818/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:33.066006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.066478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.066944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.093605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:33.095207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:33.107316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 844/1662] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:33.111441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.162157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376dfb7-fdfe-40b7-b48d-6fc0b293485e service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.186197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.187038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.187364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.187640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.188447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:33.188816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.191913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.249986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 819/1663] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:33.255565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.275345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e5ba9-948e-43fb-86cb-1494f3fc7aa9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.305442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.308142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.309603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.311112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.313300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.348534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.416463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 845/1664] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:33 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:33.420302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.448281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00802-ad56-4549-81d6-5b27fb419a82 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.577905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.579229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:33.662720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:33.686841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.691079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.692461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.692901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.695392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.702271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.714840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:33.785699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 820/1665] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:33 2022] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:33.788196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.804758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e861-b6e5-4fae-9529-48bf9ecfd79b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.824873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abb179-4107-4058-9c61-e9906fddc65c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.830449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.832258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.840221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.841919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.842046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.842125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] PATH_INFO: `/v3/users/74dfeef7e3904ad684005ab59d48923f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.842190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.842190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.843495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74dfeef7e3904ad684005ab59d48923f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.845130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.848904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.849020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:33.880976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 821/1666] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:33.882014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:33.888016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:33.931927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc27-f931-4324-877f-6bdb6c5488fe admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:33.947525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:33.950577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:33.950888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:33.951209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] PATH_INFO: `/v3/users/e44fe6b102c54a25ae59b407419b47cd` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:33.954470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44fe6b102c54a25ae59b407419b47cd)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:33.957583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:34.015363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74dfeef7e3904ad684005ab59d48923f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.026316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74dfeef7e3904ad684005ab59d48923f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.053530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74dfeef7e3904ad684005ab59d48923f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.055603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74dfeef7e3904ad684005ab59d48923f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.061374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44fe6b102c54a25ae59b407419b47cd'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.071786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44fe6b102c54a25ae59b407419b47cd'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.082999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74dfeef7e3904ad684005ab59d48923f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.095226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44fe6b102c54a25ae59b407419b47cd'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.102404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 846/1667] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:33 2022] DELETE /identity/v3/users/74dfeef7e3904ad684005ab59d48923f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:34.104141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:34.110348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.129942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44fe6b102c54a25ae59b407419b47cd'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.151753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3779e9c8-f9a7-4e3f-8e8f-e2442f79068c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44fe6b102c54a25ae59b407419b47cd'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:34.161168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 822/1668] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:33 2022] DELETE /identity/v3/users/e44fe6b102c54a25ae59b407419b47cd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:34.162989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff8e2-74a2-4db9-b5a4-f25b0837ec54 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.163345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff8e2-74a2-4db9-b5a4-f25b0837ec54 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.163747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff8e2-74a2-4db9-b5a4-f25b0837ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.203516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-653ff8e2-74a2-4db9-b5a4-f25b0837ec54 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:34.212335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-653ff8e2-74a2-4db9-b5a4-f25b0837ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.294432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b113cfb-7045-4f9a-944d-ba841113ce68 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:34.377596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 823/1669] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:34.379556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.379989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.380407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.414558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:34.418067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.429923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:34.430853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.431261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.431637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.432522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:34.437096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 824/1670] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:34.443456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:34.449018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:34.466866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:34.468589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.483781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 847/1671] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:34.486037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:34.500147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.531979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c766-9be3-4c48-8a31-5cd916258cb2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:34.549922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:34.551260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.551659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.552033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] PATH_INFO: `/v3/projects/4d6e1423f31e4237b4b029f82baa7b35/users/73e6f81931eb49e6a9e984cd53778cc3/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.593340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6e1423f31e4237b4b029f82baa7b35, user_id=73e6f81931eb49e6a9e984cd53778cc3, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:34.596141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:34.602805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:34.636711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 848/1672] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:34 2022] PUT /identity/v3/projects/4d6e1423f31e4237b4b029f82baa7b35/users/73e6f81931eb49e6a9e984cd53778cc3/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:34.637794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:34.647347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:34.661776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33df9-1444-4e08-8864-5ec2835aed4c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:34.793456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:34.794454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.794744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.795025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.815218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa92c8-31ad-4acb-8f9a-750173df8b07 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:34.824085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:34.825023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.825310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.825589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.930502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:34.932107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b380-c099-437f-9cf5-c96be24e8485 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:34.944465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 825/1673] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:34.946976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:34.947296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:34.947582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:34.983182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:34.984957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.011824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 849/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:35.016668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] MFA Rules not processed for user `73e6f81931eb49e6a9e984cd53778cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:35.022638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:35.208563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 826/1675] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:35.209176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.221292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbdcbb-d863-4241-9d99-4aabb50e6c75 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.249691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:35.252019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:35.252412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:35.252839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:35.255885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:35.259373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.306894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.308847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:35.342362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 850/1676] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:35 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:35.345927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.370526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8910a-74b7-4798-8138-d603a67f09e6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.462152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:35.481972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9871-4d63-44a9-9a32-511359a989f0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.496685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:35.497579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:35.498333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:35.498732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:35.499585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:35.501673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.521927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:35.547669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:35.548889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:35.549379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:35.549711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] PATH_INFO: `/v3/projects/187803eee85f47d0bc6e0636016dc1be` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:35.551152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187803eee85f47d0bc6e0636016dc1be)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:35.552232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: WARNING py.warnings [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:45:35.552232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: warnings.warn(msg) Jul 25 05:45:35.552232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: Jul 25 05:45:35.552804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 851/1677] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:35 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:45:35.558238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.559017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.575622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25486-b574-41fe-9f48-425b042319cb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.591914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:35.592757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:35.593051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:35.595286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:35.596651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:35.599375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.634613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 852/1678] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:45:35.638158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.661912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e38d6c-23c7-4af1-af6a-27b9d4ad49f9 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.682071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187803eee85f47d0bc6e0636016dc1be', 'request_id': 'req-454565e7-70f7-43f7-bc50-3985949e5b35'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:35.717267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187803eee85f47d0bc6e0636016dc1be', 'request_id': 'req-454565e7-70f7-43f7-bc50-3985949e5b35'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:35.738388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187803eee85f47d0bc6e0636016dc1be', 'request_id': 'req-454565e7-70f7-43f7-bc50-3985949e5b35'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:35.774885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] The token cache is being invalidate because project 187803eee85f47d0bc6e0636016dc1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:35.775435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:35.801502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:35.805908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 827/1679] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:35 2022] DELETE /identity/v3/projects/187803eee85f47d0bc6e0636016dc1be => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:35.810248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.813872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:35.867124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:35.868290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:35.868527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:35.868615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] PATH_INFO: `/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd/users/7f8f594b51554603863b9bb880a71a12/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:35.912251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a12fbdf7af489d905bd4978ae5d3dd, user_id=7f8f594b51554603863b9bb880a71a12, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:35.915712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:35.939102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454565e7-70f7-43f7-bc50-3985949e5b35 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:35.950473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 853/1680] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:35 2022] PUT /identity/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd/users/7f8f594b51554603863b9bb880a71a12/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:35.951749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:35.955841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.112715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:36.113634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.113925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.114785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] PATH_INFO: `/v3/users/d39e7d09822c422c878278162f723936` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.117929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39e7d09822c422c878278162f723936)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:36.120136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:36.141462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:36.181562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe7f1-53a8-476b-8f85-9f09a3957c53 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:36.204256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:36.207505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.207806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.208482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.214645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:36.216347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:36.272779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39e7d09822c422c878278162f723936'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:36.273511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39e7d09822c422c878278162f723936'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:36.283908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 854/1681] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:36.287932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:36.288591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39e7d09822c422c878278162f723936'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:36.292513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.312256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39e7d09822c422c878278162f723936'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:36.320935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82bf7b-e549-4991-a91d-11ba52baa3eb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:36.338205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39e7d09822c422c878278162f723936'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:36.351569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:36.352721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.353010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.353296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] PATH_INFO: `/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd/users/7f8f594b51554603863b9bb880a71a12/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.358651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 828/1682] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:35 2022] DELETE /identity/v3/users/d39e7d09822c422c878278162f723936 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:36.371046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a12fbdf7af489d905bd4978ae5d3dd, user_id=7f8f594b51554603863b9bb880a71a12, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:36.373781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd88773-c1c8-429b-9813-b45dd8e25d07 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:36.423980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 855/1683] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:36 2022] PUT /identity/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd/users/7f8f594b51554603863b9bb880a71a12/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:36.437130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:36.437297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12691-f605-4cd4-be75-31faee327678 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.437479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12691-f605-4cd4-be75-31faee327678 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.437765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12691-f605-4cd4-be75-31faee327678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.439113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.505334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bae12691-f605-4cd4-be75-31faee327678 None None] MFA Rules not processed for user `7f8f594b51554603863b9bb880a71a12`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:36.506576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bae12691-f605-4cd4-be75-31faee327678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.579288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:36.653568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 856/1684] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:36.655035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ea757-58e1-456a-8774-035c726e1cb6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:36.667901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12691-f605-4cd4-be75-31faee327678 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:36.677995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bae12691-f605-4cd4-be75-31faee327678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.813978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:36.814931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.816702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.817015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] PATH_INFO: `/v3/projects/58f41acfb11444ff9ccc46d9e083f29c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.820878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f41acfb11444ff9ccc46d9e083f29c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:36.827898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:36.842402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12691-f605-4cd4-be75-31faee327678 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:36.853843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:36.855228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:36.855897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:36.856287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:36.885066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:36.886716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:36.915088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 857/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:36.943923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:36.987850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:36.989613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:36.993348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f41acfb11444ff9ccc46d9e083f29c', 'request_id': 'req-a3677170-607b-45fb-88dc-27662baa935b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.020764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f41acfb11444ff9ccc46d9e083f29c', 'request_id': 'req-a3677170-607b-45fb-88dc-27662baa935b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.026810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2176b6-7a12-425b-b0e7-206d9fe257ac service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:37.045268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f41acfb11444ff9ccc46d9e083f29c', 'request_id': 'req-a3677170-607b-45fb-88dc-27662baa935b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.088542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] The token cache is being invalidate because project 58f41acfb11444ff9ccc46d9e083f29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:37.093135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.096867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.100634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 829/1686] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:36 2022] DELETE /identity/v3/projects/58f41acfb11444ff9ccc46d9e083f29c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:37.110306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:37.111759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:37.197927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:37.198913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:37.199291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:37.199642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] PATH_INFO: `/v3/projects/8da3c252b474448e86f2949ceac1748b` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:37.201730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da3c252b474448e86f2949ceac1748b)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:37.203940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:37.285755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da3c252b474448e86f2949ceac1748b', 'request_id': 'req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.296687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da3c252b474448e86f2949ceac1748b', 'request_id': 'req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.306897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da3c252b474448e86f2949ceac1748b', 'request_id': 'req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.310107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3677170-607b-45fb-88dc-27662baa935b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:37.327091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] The token cache is being invalidate because project 8da3c252b474448e86f2949ceac1748b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:37.327640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.328800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.354698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 858/1687] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:36 2022] DELETE /identity/v3/projects/8da3c252b474448e86f2949ceac1748b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:37.371608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:37.375924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:37.387096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:37.484470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109f04-ff7d-47e4-8795-e9a6b0f1094a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:37.495227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:37.496106 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:37.497419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:37.497720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:37.502240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:37.506880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:37.509913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:37.511225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:37.512335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] PATH_INFO: `/v3/users/beb9a8bb18384c828d8eb16b997c5bab` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:37.518760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb9a8bb18384c828d8eb16b997c5bab)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:37.525924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:37.701607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb9a8bb18384c828d8eb16b997c5bab'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.702891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb9a8bb18384c828d8eb16b997c5bab'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.722888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:37.726508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb9a8bb18384c828d8eb16b997c5bab'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.734127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979be366-38b9-47bd-8273-f395c09a5214 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:37.745269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb9a8bb18384c828d8eb16b997c5bab'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.779177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 859/1688] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:37.790498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:37.795117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25b68b-95c9-4303-9239-c09c1ec2a19c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:37.795500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25b68b-95c9-4303-9239-c09c1ec2a19c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:37.798819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25b68b-95c9-4303-9239-c09c1ec2a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:37.812388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb9a8bb18384c828d8eb16b997c5bab'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:37.829648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 830/1689] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:37 2022] DELETE /identity/v3/users/beb9a8bb18384c828d8eb16b997c5bab => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:37.830616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:37.832865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:37.864367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-eb25b68b-95c9-4303-9239-c09c1ec2a19c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:37.869290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-eb25b68b-95c9-4303-9239-c09c1ec2a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:38.016577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33f06-53ee-4e7a-94e9-a9941473b714 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.042067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.043232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.043665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.046075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] PATH_INFO: `/v3/projects/02ca5427e4684adc82fab1360509986f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.053200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ca5427e4684adc82fab1360509986f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.059024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.067160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 860/1690] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:38.076791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdba3f-7462-4369-bf61-155526957949 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.077088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdba3f-7462-4369-bf61-155526957949 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.077345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdba3f-7462-4369-bf61-155526957949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.119182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3abdba3f-7462-4369-bf61-155526957949 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:38.120430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3abdba3f-7462-4369-bf61-155526957949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:38.178088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 861/1691] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:38.184909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdba3f-7462-4369-bf61-155526957949 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.199913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ca5427e4684adc82fab1360509986f', 'request_id': 'req-b2e5e79e-1e1e-4cea-863c-af19db16f57b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:38.203577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdba3f-7462-4369-bf61-155526957949 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.218322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ca5427e4684adc82fab1360509986f', 'request_id': 'req-b2e5e79e-1e1e-4cea-863c-af19db16f57b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:38.232328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ca5427e4684adc82fab1360509986f', 'request_id': 'req-b2e5e79e-1e1e-4cea-863c-af19db16f57b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:38.255176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] The token cache is being invalidate because project 02ca5427e4684adc82fab1360509986f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:38.255691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:38.261737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-b2e5e79e-1e1e-4cea-863c-af19db16f57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:38.269369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 831/1692] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:37 2022] DELETE /identity/v3/projects/02ca5427e4684adc82fab1360509986f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:38.274058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124781c-fa33-4027-9b13-d59404ff9ba3 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.278777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124781c-fa33-4027-9b13-d59404ff9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.279271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124781c-fa33-4027-9b13-d59404ff9ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.336604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b124781c-fa33-4027-9b13-d59404ff9ba3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:38.338202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b124781c-fa33-4027-9b13-d59404ff9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:38.365679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:38.402763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.403683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.403974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.404253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.405114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:38.405889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.407107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.447295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 862/1693] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:38.451472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.454031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:38.467739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 832/1694] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:38.469587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.469997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.470390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.496090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117bd8-e3d8-4220-a7f1-2edccfa08f86 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.520890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.521593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.521882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.522165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.522364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:38.524727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:38.530576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.539600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.551584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 833/1695] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:38.552859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.584695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006044ba-e38c-4b14-a2b0-f9720cac4b83 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.603546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.604358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.604839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.605225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.606814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:38.607514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.609266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.629870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 863/1696] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:45:38.630379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:38.630765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.644060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 834/1697] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:38.646610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.671444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cb75-4038-4434-8d00-fe286906c192 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.782354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a5c0a-8d97-477c-8447-c7a113bc97d0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.789773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.791125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.791963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.792374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.793521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.796655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.832042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 864/1698] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:38.836158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.854808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bef67-599c-44d3-9656-21df1c6d43cc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.861598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.862143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.862263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.862515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.863250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.865496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.867707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.868821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.869248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.870272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.871335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.873582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.894979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 865/1699] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:38.896287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.912782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040045-c551-4694-87ec-2bb496e370c5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:38.924054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:38.925328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:38.926417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:38.927376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:38.928580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:38.932983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:38.953252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 835/1700] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/projects => generated 353 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:38.953658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 866/1701] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:38.961451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:38.961774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.003046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750133-0afe-4f6e-84c1-ccd6fb5da1e5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.051696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b541-6247-40f7-a333-c6c716eb021d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.065696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:39.066481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.067509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.067746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.068645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:39.074534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:39.140440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 836/1702] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:38 2022] POST /identity/v3/users => generated 277 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:39.152580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.177209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536e700-0758-4250-ac8e-a68a20dc5675 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.195724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:39.197238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.197999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.198482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.199546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:39.201420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:39.219878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:39.220579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.222118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.222287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] PATH_INFO: `/v3/projects/ac8d6cb6516d4937b9c64812084dc3c7/users/90ce7414fcbf421b875eb3e8475659d7/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.232886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 837/1703] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:39.233338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.254415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8644-0df3-42cf-8b97-b8510d67c60f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.256832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8d6cb6516d4937b9c64812084dc3c7, user_id=90ce7414fcbf421b875eb3e8475659d7, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:39.264085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:39.268759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:39.271029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.272093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.273939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.274893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:39.280390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74a77-52d9-473d-a777-6cdeb289a33a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:39.309918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 867/1704] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:38 2022] PUT /identity/v3/projects/ac8d6cb6516d4937b9c64812084dc3c7/users/90ce7414fcbf421b875eb3e8475659d7/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:39.312725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 838/1705] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:39.316745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.318275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.318275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.318275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.375585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:39.405493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] MFA Rules not processed for user `90ce7414fcbf421b875eb3e8475659d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:39.406751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:39.480425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8fd1-d6c0-4c17-bcdc-4b1326806e9c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.490030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:39.491563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.492289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.492968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] PATH_INFO: `/v3/projects/d9d7030bfe7747b1a4692da0d26b46ac/users/839783bf49da4a369f54d3629b8b48fa/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.540257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:39.556207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d7030bfe7747b1a4692da0d26b46ac, user_id=839783bf49da4a369f54d3629b8b48fa, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:39.574108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bd865-2e9c-4c9e-ba82-06ff7e21255f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:39.613869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 868/1706] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:39 2022] PUT /identity/v3/projects/d9d7030bfe7747b1a4692da0d26b46ac/users/839783bf49da4a369f54d3629b8b48fa/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:39.622436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 839/1707] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:39.630506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915262a8-26fe-4312-b898-f3d90316096a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:39.630801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915262a8-26fe-4312-b898-f3d90316096a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:39.631088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915262a8-26fe-4312-b898-f3d90316096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:39.639015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.646556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:39.685703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-915262a8-26fe-4312-b898-f3d90316096a None None] MFA Rules not processed for user `839783bf49da4a369f54d3629b8b48fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:39.688504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-915262a8-26fe-4312-b898-f3d90316096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:39.856584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116de0f-5e80-4a2c-bf94-3e75106b730a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:39.878398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 869/1708] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:39.884790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915262a8-26fe-4312-b898-f3d90316096a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:39.897301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-915262a8-26fe-4312-b898-f3d90316096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.065816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.066492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.066767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.067046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.098084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915262a8-26fe-4312-b898-f3d90316096a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.120044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.121499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.122129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.122420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] PATH_INFO: `/v3/projects/c4960477659247ffb14176dee2481cea` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.126048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4960477659247ffb14176dee2481cea)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.130653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.173024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.174665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.197730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 840/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:45:40.198817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.216410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b534-0106-445f-b9a4-8c3743f8aef5 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.230968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.230968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.230968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.230968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.236398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.242874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:40.252424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.294779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:40.313361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4960477659247ffb14176dee2481cea', 'request_id': 'req-41356b4c-8fef-4afc-82ea-1504575459bd'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.324086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 841/1710] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:40 2022] POST /identity/v3/projects => generated 355 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:40.325628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.356196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4960477659247ffb14176dee2481cea', 'request_id': 'req-41356b4c-8fef-4afc-82ea-1504575459bd'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.403831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4960477659247ffb14176dee2481cea', 'request_id': 'req-41356b4c-8fef-4afc-82ea-1504575459bd'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.442242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] The token cache is being invalidate because project c4960477659247ffb14176dee2481cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:40.442242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.443556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-41356b4c-8fef-4afc-82ea-1504575459bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.449145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 870/1711] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:39 2022] DELETE /identity/v3/projects/c4960477659247ffb14176dee2481cea => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:40.454818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ecf8-b93f-484d-accd-5a51a1b3baae None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.455222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ecf8-b93f-484d-accd-5a51a1b3baae None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.455585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7ecf8-b93f-484d-accd-5a51a1b3baae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.465352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c250757-ecc1-465e-8deb-a77213bdb552 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.488147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.492438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.493882 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.495399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.498868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.505510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.517537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6bc7ecf8-b93f-484d-accd-5a51a1b3baae None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:40.522740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6bc7ecf8-b93f-484d-accd-5a51a1b3baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.569781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 871/1712] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:40.572429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.572872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.573308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.580073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 842/1713] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:40 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:40.583767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.585714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.614225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:40.620068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.621247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100b41c-ec1b-4329-a936-c1e4cbc1fdf6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.628778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.629567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.629928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.631571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.633846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.638869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.652119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 872/1714] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:40.657588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.686840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 843/1715] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:40.687792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e97f8b-1b8d-4f36-a891-56b671b5de34 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.687922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.693150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.701475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.702365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.702796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.703272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.704177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:40.704641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.706408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.740867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 873/1716] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:40.741041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.753577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb72ea-1f21-4e57-add2-0bd21fb588ae admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.766528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.769018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.769469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.769581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bcdb-9434-4623-ba69-917966dedacb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:40.769897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] PATH_INFO: `/v3/users/90ce7414fcbf421b875eb3e8475659d7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.771678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ce7414fcbf421b875eb3e8475659d7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.776167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.791716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:40.794197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:40.794667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:40.795147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] PATH_INFO: `/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac/users/ad2a7ad26d8f495e9e5181f17054a337/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:40.832808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=417d5780b2be4e3f9f75bbeb1eb704ac, user_id=ad2a7ad26d8f495e9e5181f17054a337, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:40.839446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:40.892828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 874/1717] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:40 2022] PUT /identity/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac/users/ad2a7ad26d8f495e9e5181f17054a337/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:40.894774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ce7414fcbf421b875eb3e8475659d7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.895496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ce7414fcbf421b875eb3e8475659d7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.898588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.914111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ce7414fcbf421b875eb3e8475659d7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.916668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:40.923580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ce7414fcbf421b875eb3e8475659d7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.951098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ce7414fcbf421b875eb3e8475659d7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:40.966600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 844/1718] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:40 2022] DELETE /identity/v3/users/90ce7414fcbf421b875eb3e8475659d7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:40.967638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:40.969295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:41.066831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:41.118443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b6fc2-e268-4326-a19d-7bb10496a120 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:41.157238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:41.157729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.161755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f712-0204-40fa-97fa-947121e993dd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:41.164029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.164338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.173619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:41.174692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4c14b-bc44-4a5e-98f6-472214be7cb0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:41.205508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:41.214936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.216532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.217316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.218352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:41.228670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:41.251910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 845/1719] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:41.253399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.253689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.253968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.327039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 875/1720] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:40 2022] POST /identity/v3/projects => generated 367 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:41.330373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:41.330373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:41.330846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:41.338262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:41.535912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 846/1721] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:41.536786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:41.554830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:41.561043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bf8e0-5205-4260-9db1-f78e7cad69dd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:41.570282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:41.571355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.571637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.573767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] PATH_INFO: `/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac/users/ad2a7ad26d8f495e9e5181f17054a337/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.578790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=417d5780b2be4e3f9f75bbeb1eb704ac, user_id=ad2a7ad26d8f495e9e5181f17054a337, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:41.585301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:41.588366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d121712-9600-48b9-991c-aba231dfeba5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:41.599255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:41.600442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.600909 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.601499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] PATH_INFO: `/v3/users/e8fb9b236e49474a83410309279bf4d6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.605302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fb9b236e49474a83410309279bf4d6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:41.608369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:41.634182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 847/1722] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:41 2022] PUT /identity/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac/users/ad2a7ad26d8f495e9e5181f17054a337/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:41.634182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:41.715272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fb9b236e49474a83410309279bf4d6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:41.726489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fb9b236e49474a83410309279bf4d6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:41.752912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fb9b236e49474a83410309279bf4d6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:41.753800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fb9b236e49474a83410309279bf4d6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:41.768001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a43f389-b21a-4be3-af1a-56562543dced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fb9b236e49474a83410309279bf4d6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:41.785905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 876/1723] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:41 2022] DELETE /identity/v3/users/e8fb9b236e49474a83410309279bf4d6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:41.792831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.793279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.793664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.846120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49be5-debd-4efa-b662-3caa5b8c261b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:41.883328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] MFA Rules not processed for user `268380d74d1846798174e7c3539dcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:41.884586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:41.987934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:41.989097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:41.989582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:41.990081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:41.991010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:41.999477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e66dce-9926-4697-8731-6451986aeaad admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.039295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 848/1724] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:41 2022] POST /identity/v3/users => generated 284 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:42.041928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663fabd-1e50-46d6-bccf-090321a9c57f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.041928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663fabd-1e50-46d6-bccf-090321a9c57f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.042879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663fabd-1e50-46d6-bccf-090321a9c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.066215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:42.075997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 877/1725] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:42.077270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.085891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.086950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4663fabd-1e50-46d6-bccf-090321a9c57f None None] MFA Rules not processed for user `b755c5dbee064673b16b29466f308e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:42.088802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4663fabd-1e50-46d6-bccf-090321a9c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.204512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117e42f-bfca-4569-8feb-4c75f3c4209a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.209237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.210633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.210942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.211166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 849/1726] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:42.211276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.213589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.213948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.214303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.225800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.250530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.252189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ad75d-5da5-4077-846f-cd3944d48b6e service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.252985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] MFA Rules not processed for user `ad2a7ad26d8f495e9e5181f17054a337`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:42.254493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.273510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 878/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:42.274980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.275303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.275617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.284655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:42.303323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:42.304756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.319064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 879/1728] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:42.319064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.319377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.354908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d5029-3432-4ec1-af12-30490dd981bc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.361249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.362197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.362832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.363121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.363951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.366110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c57de-e7d5-416e-8b7d-b67b20495b16 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.395089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 880/1729] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:42.397393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.397393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.397393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.427304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 850/1730] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:42.441847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.446962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.455780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] MFA Rules not processed for user `268380d74d1846798174e7c3539dcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:42.457271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.505690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 881/1731] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:42.509255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.536040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75639aad-7b0f-498e-9cb8-3eaaa31a4698 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.554266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.556551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.558071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.559658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.588955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.591629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.598794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4a33-b467-4ac4-a056-0e8567644bec None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.605384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 882/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:42.606539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.613523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.614199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.614489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.614768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.625720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dfacf-d2b2-4225-8d28-e83d246f6c1e service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.634156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.636394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.641767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.642460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.642741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.643030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.643968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.645599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.665445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 851/1733] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:42.666473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.671081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 883/1734] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:42.672552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.674642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.677765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:42.696442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:42.734487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3757a6-7ba7-461c-9219-25ac88c389af admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.752961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.753644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.753934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.754217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.774149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.775809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.805262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 884/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:42.806185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:42.822932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0af07-364c-4797-8ae5-57ba95d37790 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.826450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c26e8c-dcdd-4581-920c-fed2c77a4af0 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:42.832292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.832969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.833283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.834213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.837703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:42.839100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.846458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.846861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] PATH_INFO: `/v3/projects/54cbbea173ad48e892194cf92967b605/users/9d0d413a5b7646ec97361d0b0cd15d3b/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:42.868824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.870291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e4e3-d81c-44af-bf49-ef14e347ac93 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.897354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54cbbea173ad48e892194cf92967b605, user_id=9d0d413a5b7646ec97361d0b0cd15d3b, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:42.908076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 852/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:42.909470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:42.951061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 885/1737] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:42 2022] PUT /identity/v3/projects/54cbbea173ad48e892194cf92967b605/users/9d0d413a5b7646ec97361d0b0cd15d3b/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:42.953385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:42.953677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:42.953963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:43.057455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] MFA Rules not processed for user `9d0d413a5b7646ec97361d0b0cd15d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:43.058822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:43.090054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:43.260853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38ec5-87d3-4edf-8c7b-810f0c163401 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:43.272292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:43.273728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:43.274017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:43.274297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:43.277333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:43.322630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 853/1738] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:43.322630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:43.328604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:43.469804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:43.477363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:43.509891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 886/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:43 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:45:43.511253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:43.604408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6279dd-baab-4807-83f7-a7f976026572 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:43.610574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:43.629325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:43.630346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:43.630708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:43.632321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] PATH_INFO: `/v3/projects/2053c40acd5f458991d7ea902bced1ba` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:43.634362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2053c40acd5f458991d7ea902bced1ba)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:43.637952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:43.658391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ae319-847f-4f88-9063-505d3a849e8b service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:43.667084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:43.668530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:43.668530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:43.668791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:43.669595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:43.683423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:43.749071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 887/1740] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:43 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:43.750748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:43.800315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:43.832411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2053c40acd5f458991d7ea902bced1ba', 'request_id': 'req-99ce4adc-bd22-4121-86a5-c64c6e25024b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:43.856971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2053c40acd5f458991d7ea902bced1ba', 'request_id': 'req-99ce4adc-bd22-4121-86a5-c64c6e25024b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:43.888981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2053c40acd5f458991d7ea902bced1ba', 'request_id': 'req-99ce4adc-bd22-4121-86a5-c64c6e25024b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:43.920826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] The token cache is being invalidate because project 2053c40acd5f458991d7ea902bced1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:43.922368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:43.924083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:43.933901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fb80b-0989-4147-b774-a7cf4c3bc763 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:43.934472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 854/1741] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:43 2022] DELETE /identity/v3/projects/2053c40acd5f458991d7ea902bced1ba => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:43.939216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:43.942577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.065748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.067250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.067742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.068180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.069086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.073362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef8500-cb4d-4c76-a482-2fa6cdac21b8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.106204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 888/1742] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:43 2022] POST /identity/v3/users => generated 291 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:44.108801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.109196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.109622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.134473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.138238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.160940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 889/1743] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:44.161867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:44.163910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.172901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4adc-bd22-4121-86a5-c64c6e25024b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.180248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f28770-3532-4bf1-84aa-68edee1431ff None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.185572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.186853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.187182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.187450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.188440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.191075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050ad08-4689-4e31-afed-f3b5d84515a3 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.202988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.204997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 890/1744] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:44.206778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.207207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.207546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.207868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.208297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] PATH_INFO: `/v3/projects/ac8d6cb6516d4937b9c64812084dc3c7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.208503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.212056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8d6cb6516d4937b9c64812084dc3c7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.223044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.231599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.233526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.245971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 891/1745] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:44.247449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:44.260388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c75e-46d9-48e9-becd-0319b1b84d4e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.279831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.283127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.283602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.283889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] PATH_INFO: `/v3/projects/c8dd530c513745c88112c1a36bf5d263/users/03aff693b0b445599c58c12e9db3af56/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.340043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dd530c513745c88112c1a36bf5d263, user_id=03aff693b0b445599c58c12e9db3af56, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.344331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.377941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8d6cb6516d4937b9c64812084dc3c7', 'request_id': 'req-28e46756-a81d-4a34-8e4c-8a12416a5be7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:44.383215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 892/1746] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:44 2022] PUT /identity/v3/projects/c8dd530c513745c88112c1a36bf5d263/users/03aff693b0b445599c58c12e9db3af56/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:44.383215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:44.391876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8d6cb6516d4937b9c64812084dc3c7', 'request_id': 'req-28e46756-a81d-4a34-8e4c-8a12416a5be7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:44.409378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:44.412166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8d6cb6516d4937b9c64812084dc3c7', 'request_id': 'req-28e46756-a81d-4a34-8e4c-8a12416a5be7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:44.433866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] The token cache is being invalidate because project ac8d6cb6516d4937b9c64812084dc3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:44.434443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:44.435322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:44.437139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 855/1747] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:43 2022] DELETE /identity/v3/projects/ac8d6cb6516d4937b9c64812084dc3c7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:44.440136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:44.443670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.544232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61ccd-9561-48c2-88c0-38d4f214b39f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.596299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.598865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.599201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.599495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.600312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:44.601289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.603244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09570e39-833b-4489-aa44-394177d2ba5f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.629105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 893/1748] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:44.630712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189127d-1462-42ab-8793-99c2ae6c0c4c None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.631007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189127d-1462-42ab-8793-99c2ae6c0c4c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.631321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189127d-1462-42ab-8793-99c2ae6c0c4c None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.633654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 894/1749] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 05:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:44.635523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fcb9d-86c0-48c2-a505-a68a4980f6ce None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.635635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e46756-a81d-4a34-8e4c-8a12416a5be7 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.636668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fcb9d-86c0-48c2-a505-a68a4980f6ce None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.636668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fcb9d-86c0-48c2-a505-a68a4980f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.651332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.652046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.652331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.652611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.653363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.656614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.658777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:44.662239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-465fcb9d-86c0-48c2-a505-a68a4980f6ce None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.663641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-465fcb9d-86c0-48c2-a505-a68a4980f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.681531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 895/1750] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:44.683206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91237a9-4c4d-4450-b7dd-78a3bde057f5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.683573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91237a9-4c4d-4450-b7dd-78a3bde057f5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.683925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91237a9-4c4d-4450-b7dd-78a3bde057f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.687893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 856/1751] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:44.689105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:44.692682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.733221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9cac0-22fd-4cb1-901f-309b1db6bd32 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:44.738381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f91237a9-4c4d-4450-b7dd-78a3bde057f5 None None] MFA Rules not processed for user `7c8067d2568e4ec1a9f2824d55922cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.743702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:44.743905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f91237a9-4c4d-4450-b7dd-78a3bde057f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.744392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.744678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.744960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.745829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:44.751577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57712328-c9fb-4483-be4d-c0f91583c6f2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:44.810001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 857/1752] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:44.811640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.811939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.812218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.917451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 896/1753] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:44.928248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.928435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:44.928532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:44.929633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:44.932328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:44.971390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:44.972641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:45.069098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 858/1754] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:45.070667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.151400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 897/1755] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:45.152383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.179903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e529282-af56-4c87-8b4d-f2dade1d99fd None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.196112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.197029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.197349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.197754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.198547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.201623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0f904-fe1b-4e3d-b41a-27e1521066cd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.235797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc830e-6f0b-407d-ae41-ddd2d7902bd2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.254504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 898/1756] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:45 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:45.256178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.259286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.260063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.260351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.260627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] PATH_INFO: `/v3/projects/c8dd530c513745c88112c1a36bf5d263/users/03aff693b0b445599c58c12e9db3af56/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.262486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.262722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.272846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dd530c513745c88112c1a36bf5d263, user_id=03aff693b0b445599c58c12e9db3af56, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.292294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.315582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:45.324881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] MFA Rules not processed for user `7c8067d2568e4ec1a9f2824d55922cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:45.326595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:45.344620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 859/1757] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:45 2022] PUT /identity/v3/projects/c8dd530c513745c88112c1a36bf5d263/users/03aff693b0b445599c58c12e9db3af56/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:45.345739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.357793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:45.446454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 899/1758] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:45.447240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.490982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf2112-26b4-437d-b906-d0a9a6b9b2da admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.497436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.498642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.499197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.499735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.512224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.515605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.544095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 860/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:45.546926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.575806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:45.603899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794d6aa-1fca-4e74-b524-bb2e84172cd5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.609881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.611012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.612429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.612920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.616830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:45:45.617633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.620942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803d24-b8bc-403b-9675-6cb59019a93c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.639168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 900/1760] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:45:45.641647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.642520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.643146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.679881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] MFA Rules not processed for user `03aff693b0b445599c58c12e9db3af56`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:45.682205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:45.735805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119fa3-19b9-4952-a54f-d7550d3f42e8 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.762379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.763489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.764719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.767230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.769868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.774046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.805539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 861/1761] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:45.805953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.812021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:45.867619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 901/1762] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:45.868514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.883360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c419-ba00-4492-b3f7-5c6fda045cb5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:45.890148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:45.890838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:45.891123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:45.891431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:45.892140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:45.895260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:45.935733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 902/1763] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:45 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:45.936696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:45.952008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:45.989565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f599664-a204-46c3-863a-67574b0e1c61 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.096009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fbcf4-a7c6-485a-a180-008f2520fdc1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.110148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.112165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.112455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.112741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.113491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.115162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.134901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 903/1764] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:46.136184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:46.138188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:46.203615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.205772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.206297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.207621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.356373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:46.359804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4b77-6cb3-482d-a781-35ca4e9224db admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.383911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.386873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.397361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.397361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.425424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.432187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.470819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 862/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:46.472101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:46.534505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bb2d2-1036-4fc1-8381-416b5fb1ce1b service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.576408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.577109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.577449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.577666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.578832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.592490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.665034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.671442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d45a3-e274-44dc-85e6-322090b6c2b0 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.676241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 863/1766] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:46 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:46.677162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:46.704229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbbfc5-78e7-4240-bbe5-6a9758134339 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.724290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.725538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.726468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.726900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] PATH_INFO: `/v3/projects/a6aa68cfa7a947c7a21eaca9fc55096a/users/c440689397f04e9bb09471cbfc1c5326/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.747018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 904/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:46.769242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6aa68cfa7a947c7a21eaca9fc55096a, user_id=c440689397f04e9bb09471cbfc1c5326, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.773174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756b23-c7db-4c22-bfc7-93c4fb5bcae5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.783038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef41a2-37b4-4441-8451-9acf3f995e77 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.783477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef41a2-37b4-4441-8451-9acf3f995e77 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.788865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef41a2-37b4-4441-8451-9acf3f995e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.815332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 864/1768] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:46 2022] PUT /identity/v3/projects/a6aa68cfa7a947c7a21eaca9fc55096a/users/c440689397f04e9bb09471cbfc1c5326/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:46.817636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069200c8-e4ae-4361-9997-bdc9daddb1dc None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.818086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069200c8-e4ae-4361-9997-bdc9daddb1dc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.818519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069200c8-e4ae-4361-9997-bdc9daddb1dc None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.820640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 865/1769] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 25 05:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:46.821660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069200c8-e4ae-4361-9997-bdc9daddb1dc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:46.837915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-30ef41a2-37b4-4441-8451-9acf3f995e77 None None] MFA Rules not processed for user `b755c5dbee064673b16b29466f308e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:46.839357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-30ef41a2-37b4-4441-8451-9acf3f995e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:46.921856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:46.942981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 905/1770] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:46.942981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa2a3-24e5-40ce-bd17-3700f7e0a6e2 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.942981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa2a3-24e5-40ce-bd17-3700f7e0a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.943362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069200c8-e4ae-4361-9997-bdc9daddb1dc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:46.943443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa2a3-24e5-40ce-bd17-3700f7e0a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.972610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:46.974436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:46.975047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:46.975369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:46.977616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:46.982511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd887969-ed4d-4dd6-8033-d58402fe68cc admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:46.985302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-603aa2a3-24e5-40ce-bd17-3700f7e0a6e2 None None] MFA Rules not processed for user `268380d74d1846798174e7c3539dcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:46.986847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-603aa2a3-24e5-40ce-bd17-3700f7e0a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:47.008327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 866/1771] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:47.009976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.010437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.010902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.108504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] MFA Rules not processed for user `c440689397f04e9bb09471cbfc1c5326`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:47.120431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:47.176467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 906/1772] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:47.176467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.176467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.178035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.219890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:47.222333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:47.293380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 867/1773] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:47.294131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:47.342798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25509e-63a0-4fa6-85b2-5be2dbf340ec None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:47.368630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:47.369328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.369615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.369898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.370650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:47.380204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:47.403955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 868/1774] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:47.406190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:47.427458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037e06-5376-474b-9b96-a3ab329d8476 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:47.445053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 907/1775] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 25 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:47.456035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:47.461296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:47.463491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.464179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.465245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.467415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:47.474481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:47.487482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8fbf3-c884-4304-81e1-5f958b3c9b1e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:47.502575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:47.508503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:47.509707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.511864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.512347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] PATH_INFO: `/v3/projects/752d2f2352e74f019d58d0bf5578d12d/users/507b8d67350840848f0c92cd05712524/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.555320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 869/1776] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:47 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:47.557180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:47.577167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=752d2f2352e74f019d58d0bf5578d12d, user_id=507b8d67350840848f0c92cd05712524, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:47.580229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:47.610342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 908/1777] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:47 2022] PUT /identity/v3/projects/752d2f2352e74f019d58d0bf5578d12d/users/507b8d67350840848f0c92cd05712524/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:47.611221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:47.752946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644beda-ddb7-42c0-89ee-ebd8ef668c5e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:47.753756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7082c-4ac6-4e4c-969b-ace84e3a16ed admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:47.771228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:47.771946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.773062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.773468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.774379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:47.782521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec242d24-8c14-4a6d-87e0-a28396ce88c1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:47.834571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 909/1778] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:47 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:47.836846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323bc0-7c30-4e2e-a2f9-494b91c83482 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.837139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323bc0-7c30-4e2e-a2f9-494b91c83482 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.837514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82323bc0-7c30-4e2e-a2f9-494b91c83482 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.856951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 910/1779] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 05:45:47 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:45:47.861802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3701f-4450-4197-bd74-e00e42cfb1de None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:47.861976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3701f-4450-4197-bd74-e00e42cfb1de None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:47.862229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3701f-4450-4197-bd74-e00e42cfb1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:47.911392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:47.951025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-93c3701f-4450-4197-bd74-e00e42cfb1de None None] MFA Rules not processed for user `507b8d67350840848f0c92cd05712524`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:47.956825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-93c3701f-4450-4197-bd74-e00e42cfb1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:48.008252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:48.013374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.013727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.021774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.035454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:48.106861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:48.131931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:48.188678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 870/1780] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:48.189819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:48.232430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f549a-2b95-4ede-b5d0-ef2f419888f7 service placement] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:48.242895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 911/1781] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:48.265378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.266437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.266857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.272913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:48.277609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.279444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.280781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.286656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:48.299207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:48.365894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:48.368314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 871/1782] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:48.375940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:48.378969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:48.415912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f10e-3a55-43ee-a2ef-924c9b7b510a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:48.454183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:48.462712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.463354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.465336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.467345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:48.474587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:48.573127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 872/1783] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:45:48 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:48.574785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:48.628018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 912/1784] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:48.629736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:48.700502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4e6d6-24bd-4845-a101-36951a6667d3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:48.762484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:48.806512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31870e9d-0ea6-4496-96a4-e7e39ed94ac1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:48.827560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:48.836258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.837813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.841844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] PATH_INFO: `/v3/projects/d74db28046174247aef78ef97cf497a7/users/5a2342e101bd4a98b1d3df32efb191c1/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.881108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:48.882832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:48.883761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:48.884240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:48.885229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:48.888644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:48.916992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74db28046174247aef78ef97cf497a7, user_id=5a2342e101bd4a98b1d3df32efb191c1, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:48.920298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:48.941748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 913/1785] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:45:48 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:45:48.943194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:48.947074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:48.958783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 873/1786] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:48 2022] PUT /identity/v3/projects/d74db28046174247aef78ef97cf497a7/users/5a2342e101bd4a98b1d3df32efb191c1/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:48.959688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.092186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:49.127238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fee519-2540-4e3c-bd95-f7b66f3a8944 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.137049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd37660-23ae-4c96-8820-e13903b887ff admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.139760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.140449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.140729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.141002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.145606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.152357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.185962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 874/1787] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:49.192040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.223840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62f4a8-9416-4501-98df-b67e26034e53 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.251203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.251936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.255232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.255536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.259043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.272450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.315337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 875/1788] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:49.316292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.332084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.332784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.333070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.333346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.341389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b3f1-ad99-430a-9f41-d908b2d43b43 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.357218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.358139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.358418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.359989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] PATH_INFO: `/v3/projects/12dedf6555e343c79e500b0e8adad9d4/users/50e9542e566a4880a8fc2a9f299a433a/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.361387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.363917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.386396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 914/1789] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:49.387480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.410661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00504-2cb1-4888-af2d-205904040f75 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.415819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dedf6555e343c79e500b0e8adad9d4, user_id=50e9542e566a4880a8fc2a9f299a433a, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.419184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.433345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.434181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.434466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.434802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] PATH_INFO: `/v3/projects/d74db28046174247aef78ef97cf497a7/users/5a2342e101bd4a98b1d3df32efb191c1/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.445321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74db28046174247aef78ef97cf497a7, user_id=5a2342e101bd4a98b1d3df32efb191c1, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.456561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ac3a-b4e8-45b8-a4ab-0aacaee2d57a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.474420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 876/1790] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:49 2022] PUT /identity/v3/projects/12dedf6555e343c79e500b0e8adad9d4/users/50e9542e566a4880a8fc2a9f299a433a/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:49.478659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.536117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 915/1791] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:49 2022] PUT /identity/v3/projects/d74db28046174247aef78ef97cf497a7/users/5a2342e101bd4a98b1d3df32efb191c1/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:49.540477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c1f5-13b6-43eb-b656-53945618aa74 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.540772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c1f5-13b6-43eb-b656-53945618aa74 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.541256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924c1f5-13b6-43eb-b656-53945618aa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.611916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6924c1f5-13b6-43eb-b656-53945618aa74 None None] MFA Rules not processed for user `5a2342e101bd4a98b1d3df32efb191c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:49.613407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6924c1f5-13b6-43eb-b656-53945618aa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:49.704177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a780de0-21c4-42b2-8423-0a9904b1c0c3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.771642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:49.812524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.814393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.814846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.816350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.817238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.819416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.842071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 877/1792] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:45:49.843203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.857674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c48de-0a24-43bc-ae8b-a0964f0ef418 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:49.869631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:49.870549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.874025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.874362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] PATH_INFO: `/v3/projects/12dedf6555e343c79e500b0e8adad9d4/users/50e9542e566a4880a8fc2a9f299a433a/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.880891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dedf6555e343c79e500b0e8adad9d4, user_id=50e9542e566a4880a8fc2a9f299a433a, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:49.885172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:49.888438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 916/1793] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:49.903071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 878/1794] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:45:49 2022] PUT /identity/v3/projects/12dedf6555e343c79e500b0e8adad9d4/users/50e9542e566a4880a8fc2a9f299a433a/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:49.917673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:49.918034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:49.918377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:49.932223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:49.994949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] MFA Rules not processed for user `50e9542e566a4880a8fc2a9f299a433a`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:49.996714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:50.118447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dae1-ffe4-4af7-883d-d4d46e329726 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:50.136992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:50.137776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:50.138181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:50.138552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:50.239414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:50.241552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:50.242723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:50.262578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 879/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:50.294938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 917/1796] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:45:50.484047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:50.505247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d08ad-a413-4a69-ad39-4aabda9383c0 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:50.513964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:50.515050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:50.515473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:50.517043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:50.552617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:50.555633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:50.602257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 880/1797] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:51.164305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:51.168480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:51.207583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6134929-15de-4d9f-a7cb-e2721f6ca226 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:51.224560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:51.230932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:51.232528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:51.233440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:51.439268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:51.440991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:51.463953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 918/1798] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:52.898019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:52.942515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:53.149726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734bba2-dedc-4d9b-affa-6890355ad9aa service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:53.171421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2f74-c0de-4669-9aa2-04cfd352c208 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:53.183949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:53.184706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.185080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.185354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] PATH_INFO: `/v3/users/507b8d67350840848f0c92cd05712524` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.187238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=507b8d67350840848f0c92cd05712524)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:53.190498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:53.238858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:53.248793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.252082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.255010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] PATH_INFO: `/v3/users/c440689397f04e9bb09471cbfc1c5326` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.277265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c440689397f04e9bb09471cbfc1c5326)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:53.279801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:53.305496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:53.305710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507b8d67350840848f0c92cd05712524'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.321993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507b8d67350840848f0c92cd05712524'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.352140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507b8d67350840848f0c92cd05712524'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.353503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507b8d67350840848f0c92cd05712524'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.365218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b0949ab7-c397-4013-9cb0-dfbd5d06fd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507b8d67350840848f0c92cd05712524'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.391547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 919/1799] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:52 2022] DELETE /identity/v3/users/507b8d67350840848f0c92cd05712524 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:45:53.394333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21d10-a8b5-4f3f-b771-09315ee2f7ff None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.394793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21d10-a8b5-4f3f-b771-09315ee2f7ff None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.395231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21d10-a8b5-4f3f-b771-09315ee2f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.440569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:53.512399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c440689397f04e9bb09471cbfc1c5326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.515891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c440689397f04e9bb09471cbfc1c5326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.540300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a1d21d10-a8b5-4f3f-b771-09315ee2f7ff None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:53.543067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c440689397f04e9bb09471cbfc1c5326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.546746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a1d21d10-a8b5-4f3f-b771-09315ee2f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:53.578072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c440689397f04e9bb09471cbfc1c5326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.635184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bec40e17-55bb-4331-974b-4e2c658a0333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c440689397f04e9bb09471cbfc1c5326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:53.690462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 881/1800] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:52 2022] DELETE /identity/v3/users/c440689397f04e9bb09471cbfc1c5326 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:53.695869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.698952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.699599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.753339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 920/1801] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:53.755468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.756127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.756127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.760212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:53.765809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:53.810954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:53.814521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:53.895082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 882/1802] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:53.895765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:53.897339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:53.921721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33021e1-2283-4573-a31e-7eebe607859e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:53.939356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:53.941181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:53.942051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:53.942673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] PATH_INFO: `/v3/users/9d0d413a5b7646ec97361d0b0cd15d3b` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:53.947638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0d413a5b7646ec97361d0b0cd15d3b)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:53.951698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:54.023410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 921/1803] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:54.024245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:54.025466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.086472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0d413a5b7646ec97361d0b0cd15d3b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:54.087995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0d413a5b7646ec97361d0b0cd15d3b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:54.103675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0d413a5b7646ec97361d0b0cd15d3b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:54.121627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0d413a5b7646ec97361d0b0cd15d3b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:54.140637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:54.165241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0d413a5b7646ec97361d0b0cd15d3b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:54.176660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 883/1804] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:53 2022] DELETE /identity/v3/users/9d0d413a5b7646ec97361d0b0cd15d3b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:54.181793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:54.183661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.281221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:54.296049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af62847-a0f3-4980-bbf7-1dcb1cf3ece9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:54.311790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132a245-6ffd-4bfb-adc7-baaef85f0fc3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:54.317122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:54.318185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:54.318477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:54.318757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:54.323337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.436711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:54.437697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:54.438396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ec2f-7972-4e89-a4c0-732a8b88769c service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:54.438989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:54.439667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:54.440135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:54.445226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.465113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 884/1805] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:54.466577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:54.466869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:54.467161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:54.486760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:54.488081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.497445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 885/1806] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:54.534580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:54.549927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ce7c-097f-4914-b82b-649a6bc06a1b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:54.560805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:54.561694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:54.562251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:54.562608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:54.581429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:54.582971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:54.585958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:54.587542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b060-5692-43ad-9944-8a260a1d98a0 service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:54.601298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 886/1807] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:45:54.602336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:54.608185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.615576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 922/1808] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:45:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:45:54.634013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987bb7-648c-49da-b5f7-626029e7d121 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:54.653124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:54.656738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:54.657240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:54.657729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:54.661334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:54.691913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:54.695717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:54.724455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 887/1809] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:55.552358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:55.553677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:55.554941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:55.606573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:45:55.607993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:55.626855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 923/1810] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 05:45:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:45:55.692672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:55.702948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444fbd3-f0fd-4a29-9b2c-73c410c0d1c5 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:55.723815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:55.724496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:55.724780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:55.725055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:55.756242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:55.768036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:55.814737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 888/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:45:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:45:56.745347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:56.746854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:56.795992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1e46-e4df-429c-a50c-3258498209e5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:56.807889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:56.809044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:56.809492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:56.809936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] PATH_INFO: `/v3/projects/752d2f2352e74f019d58d0bf5578d12d` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:56.820442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] RBAC: Authorizing `identity:delete_project(project_id=752d2f2352e74f019d58d0bf5578d12d)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:56.828127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:56.963276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752d2f2352e74f019d58d0bf5578d12d', 'request_id': 'req-da371b79-ee5c-49d4-8c88-434adb6a596e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:56.990116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752d2f2352e74f019d58d0bf5578d12d', 'request_id': 'req-da371b79-ee5c-49d4-8c88-434adb6a596e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.012069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752d2f2352e74f019d58d0bf5578d12d', 'request_id': 'req-da371b79-ee5c-49d4-8c88-434adb6a596e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.054571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] The token cache is being invalidate because project 752d2f2352e74f019d58d0bf5578d12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:57.055380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.057513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.063628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 924/1812] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:56 2022] DELETE /identity/v3/projects/752d2f2352e74f019d58d0bf5578d12d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:57.067446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:57.094703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920877b-d6cc-41a1-ad4c-3d42ccb24139 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:57.240820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:57.291498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:57.296865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:57.300858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:57.302458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] PATH_INFO: `/v3/users/50e9542e566a4880a8fc2a9f299a433a` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:57.309616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e9542e566a4880a8fc2a9f299a433a)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:57.318145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:57.656148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e9542e566a4880a8fc2a9f299a433a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.659406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e9542e566a4880a8fc2a9f299a433a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.690602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e9542e566a4880a8fc2a9f299a433a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.714806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e9542e566a4880a8fc2a9f299a433a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.754804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e9542e566a4880a8fc2a9f299a433a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:57.770452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 889/1813] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:57 2022] DELETE /identity/v3/users/50e9542e566a4880a8fc2a9f299a433a => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:57.821164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:57.823369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:57.847245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371b79-ee5c-49d4-8c88-434adb6a596e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:57.887690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:58.007804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:58.009236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:58.009745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:58.010192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] PATH_INFO: `/v3/projects/a6aa68cfa7a947c7a21eaca9fc55096a` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:58.011713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6aa68cfa7a947c7a21eaca9fc55096a)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:58.014049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:58.159078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6aa68cfa7a947c7a21eaca9fc55096a', 'request_id': 'req-896ae0bf-7df8-4c83-b881-2f79bbba78da'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.177481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6aa68cfa7a947c7a21eaca9fc55096a', 'request_id': 'req-896ae0bf-7df8-4c83-b881-2f79bbba78da'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.200958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6aa68cfa7a947c7a21eaca9fc55096a', 'request_id': 'req-896ae0bf-7df8-4c83-b881-2f79bbba78da'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.234438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] The token cache is being invalidate because project a6aa68cfa7a947c7a21eaca9fc55096a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:58.235627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.236594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.239036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 925/1814] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:57 2022] DELETE /identity/v3/projects/a6aa68cfa7a947c7a21eaca9fc55096a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:58.243615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:58.245097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:58.280674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620712a-0a3b-4f8b-a4d3-80bb94b732f6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:58.482578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:58.485445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:58.485911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:58.487912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] PATH_INFO: `/v3/users/5a2342e101bd4a98b1d3df32efb191c1` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:58.489477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2342e101bd4a98b1d3df32efb191c1)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:58.494252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:58.693911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2342e101bd4a98b1d3df32efb191c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.693911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2342e101bd4a98b1d3df32efb191c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.712889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2342e101bd4a98b1d3df32efb191c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.741533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2342e101bd4a98b1d3df32efb191c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.777530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:58.782379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2342e101bd4a98b1d3df32efb191c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:58.797055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 890/1815] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:58 2022] DELETE /identity/v3/users/5a2342e101bd4a98b1d3df32efb191c1 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:58.860665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:58.863062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:58.890136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae0bf-7df8-4c83-b881-2f79bbba78da admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:59.052729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:59.054846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:59.055417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:59.055731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] PATH_INFO: `/v3/projects/54cbbea173ad48e892194cf92967b605` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:59.057026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54cbbea173ad48e892194cf92967b605)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:59.058968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:59.167914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54cbbea173ad48e892194cf92967b605', 'request_id': 'req-759276b9-15e4-4166-8c36-5a61141b5ab9'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.174275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:45:59.181720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54cbbea173ad48e892194cf92967b605', 'request_id': 'req-759276b9-15e4-4166-8c36-5a61141b5ab9'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.194635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54cbbea173ad48e892194cf92967b605', 'request_id': 'req-759276b9-15e4-4166-8c36-5a61141b5ab9'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.208141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] The token cache is being invalidate because project 54cbbea173ad48e892194cf92967b605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:45:59.208441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.209360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-759276b9-15e4-4166-8c36-5a61141b5ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.212268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 926/1816] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:45:58 2022] DELETE /identity/v3/projects/54cbbea173ad48e892194cf92967b605 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:45:59.217731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:45:59.225695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:45:59.262985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ef97-2111-4559-a23e-1dfdc18ed79e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:45:59.533656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:45:59.536683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:45:59.538255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:45:59.538995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] PATH_INFO: `/v3/users/03aff693b0b445599c58c12e9db3af56` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:45:59.549967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03aff693b0b445599c58c12e9db3af56)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:45:59.552637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:45:59.687682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03aff693b0b445599c58c12e9db3af56'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.688493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03aff693b0b445599c58c12e9db3af56'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.704765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03aff693b0b445599c58c12e9db3af56'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.736601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03aff693b0b445599c58c12e9db3af56'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.779199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-517c930d-9a2f-4b0c-821a-7ffbaf6f3085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03aff693b0b445599c58c12e9db3af56'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:45:59.801610 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 891/1817] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:45:59 2022] DELETE /identity/v3/users/03aff693b0b445599c58c12e9db3af56 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:00.199020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:00.199783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:00.199959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:00.203784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 927/1818] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:46:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:46:00.374627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:00.375703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:00.376144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:00.415628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:00.417381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:00.518841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 892/1819] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:00.825477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:00.827413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:00.862670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947df2a-096d-4852-ae37-e1125cd789c4 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:00.872882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:00.874574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:00.874840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:00.875456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:00.894651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:00.897796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643a989-7270-48dc-afdd-fb67e518a3df service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:00.935462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 928/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:01.144874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:01.149161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:01.158250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:01.283375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac633114-0f14-4309-9dc2-5c4ec34c6cc3 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:01.292805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:01.295202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.295814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.296767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] PATH_INFO: `/v3/projects/12dedf6555e343c79e500b0e8adad9d4` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.300155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12dedf6555e343c79e500b0e8adad9d4)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:01.305685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:01.416573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258436-360b-4203-bb8b-8ee39ced0190 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.417568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258436-360b-4203-bb8b-8ee39ced0190 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.418064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258436-360b-4203-bb8b-8ee39ced0190 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.420340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 929/1821] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:46:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:46:01.435670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12dedf6555e343c79e500b0e8adad9d4', 'request_id': 'req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:01.463899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12dedf6555e343c79e500b0e8adad9d4', 'request_id': 'req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:01.482319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12dedf6555e343c79e500b0e8adad9d4', 'request_id': 'req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:01.512204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] The token cache is being invalidate because project 12dedf6555e343c79e500b0e8adad9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:01.512698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:01.520855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e33f28ef-aac4-43f0-80ea-5cf5bdb9d802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:01.522449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 893/1822] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:01 2022] DELETE /identity/v3/projects/12dedf6555e343c79e500b0e8adad9d4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:01.528453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2cc88-68a1-4344-8f7d-ed1e77aead6d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.529074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2cc88-68a1-4344-8f7d-ed1e77aead6d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.529543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.529909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.530129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.530822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2cc88-68a1-4344-8f7d-ed1e77aead6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.580355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4bf2cc88-68a1-4344-8f7d-ed1e77aead6d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:01.586834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4bf2cc88-68a1-4344-8f7d-ed1e77aead6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:01.592444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:01.604340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:01.756752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 930/1823] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:01.764758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.765050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.765507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.809075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:01.810274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:01.846627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 931/1824] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:01.848536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:01.882430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6ba8-68cc-4e3c-a504-8a3f2a7e9498 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:01.902130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 894/1825] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:01.911031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:01.915694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:01.917038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:01.919123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:01.921020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:01.924814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:01.931884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:01.984250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 932/1826] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:01.989363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.003902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f4b4-5123-4952-b5be-1a2666dbc3e5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:02.032498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:02.035367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.035367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.035367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.035367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:02.036696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:02.116141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 895/1827] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:01 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:02.122131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.149255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbff25a-a5ac-4970-b438-3e1c66ea8fd7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:02.361669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:02.362630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.364150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.364999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.367363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:02.369557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:02.403037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 933/1828] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:02 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:02.408010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.419770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:02.427755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c712-44ed-4092-9177-edb465e37dde admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:02.460252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:02.461448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.461837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.462221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.463247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:02.465006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:02.514933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 896/1829] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:02.519072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.537058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68889b7-d493-485d-8bc1-baebdfc019b1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:02.564722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:02.569065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.570206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.573838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.577800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:02.583892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2913e-f6fa-4243-bde9-3f102236e8f1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:02.625821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 934/1830] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:02.629674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.651453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d0d0e-aa0a-4065-9af9-915c2f642160 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:02.660389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:02.661716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.662261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.663338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] PATH_INFO: `/v3/projects/0cdad657dbf94cdaa34cc96c662c555d/users/96d4f76426684dc28d6f34e936f19c15/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.712252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdad657dbf94cdaa34cc96c662c555d, user_id=96d4f76426684dc28d6f34e936f19c15, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:02.715209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:02.749616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 897/1831] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:02 2022] PUT /identity/v3/projects/0cdad657dbf94cdaa34cc96c662c555d/users/96d4f76426684dc28d6f34e936f19c15/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:02.762716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:02.763541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:02.764237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:02.829203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:02.831570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:02.862789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] MFA Rules not processed for user `96d4f76426684dc28d6f34e936f19c15`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:02.864379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:02.916591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:03.017876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc8f9-03eb-4491-a088-bc77fc107dc9 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:03.034028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:03.035119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:03.035658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:03.036323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:03.085836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:03.090363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:03.090834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 935/1832] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:03.118784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:03.120664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:03.159964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 898/1833] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:03.201449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:03.202913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:03.448433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bfbed-3424-4782-b184-ea8fb1bba030 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:03.457144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:03.458099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:03.458385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:03.458756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] PATH_INFO: `/v3/projects/d74db28046174247aef78ef97cf497a7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:03.461865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74db28046174247aef78ef97cf497a7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:03.466541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:03.512791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709598f7-3f27-4495-a2a4-9a0d7021c90f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:03.527784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:03.530589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:03.533319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:03.543222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:03.574396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:03.577102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b782d9-8c9f-4904-b436-d5f80b1c9a22 service glance] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:03.589749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74db28046174247aef78ef97cf497a7', 'request_id': 'req-f093c92c-185a-421c-9b0f-147ab0e2464b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:03.617450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74db28046174247aef78ef97cf497a7', 'request_id': 'req-f093c92c-185a-421c-9b0f-147ab0e2464b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:03.620933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 936/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:03.623818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:03.635277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74db28046174247aef78ef97cf497a7', 'request_id': 'req-f093c92c-185a-421c-9b0f-147ab0e2464b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:03.671849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] The token cache is being invalidate because project d74db28046174247aef78ef97cf497a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:03.672465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:03.673301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f093c92c-185a-421c-9b0f-147ab0e2464b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:03.678981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 899/1835] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:03 2022] DELETE /identity/v3/projects/d74db28046174247aef78ef97cf497a7 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:03.683798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:03.684351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:03.684804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:03.758841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:03.760960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:03.950450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 937/1836] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:03.950945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:03.951451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:03.952060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:03.998456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:04.001227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:04.023194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 900/1837] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:04.025168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.058734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b92d0-99a1-4eb1-9f7c-689348d847a0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.076426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.077171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.077457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.077738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.078478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:04.078803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.087507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.134157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 938/1838] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:04.138540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.153396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8fa81-e01e-4ee3-b0db-201b545bc83d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.167765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.168482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.168787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.169039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.172207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.180996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.297836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 901/1839] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:04 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:04.301906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.314964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cafc1-67a5-4904-b515-bee81631f4b2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.439788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:04.536777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.539334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.539610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.539894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.542735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.550653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.611912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 939/1840] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:04 2022] POST /identity/v3/users => generated 304 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:04.621564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.638155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed4b01-9967-438f-a423-d0a071333bef admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.643728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.645961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:04.667488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.668189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.668469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.668744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.669481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.676964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.690735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73ebf0-b0f4-45e8-a005-d221237e98c0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.714438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.722310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.722592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.722879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] PATH_INFO: `/v3/projects/c8dd530c513745c88112c1a36bf5d263` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.729320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dd530c513745c88112c1a36bf5d263)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.732326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 902/1841] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:04.733256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:04.733697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.743942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:04.799630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dba4-0345-4377-85cf-61cfc153549b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:04.826638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:04.827371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:04.827658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:04.830036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] PATH_INFO: `/v3/users/839783bf49da4a369f54d3629b8b48fa` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:04.832609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] RBAC: Authorizing `identity:delete_user(user_id=839783bf49da4a369f54d3629b8b48fa)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:04.834722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:04.937022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dd530c513745c88112c1a36bf5d263', 'request_id': 'req-33b44587-ab5e-4662-9010-291064f8a79f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:04.957831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dd530c513745c88112c1a36bf5d263', 'request_id': 'req-33b44587-ab5e-4662-9010-291064f8a79f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:04.977631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dd530c513745c88112c1a36bf5d263', 'request_id': 'req-33b44587-ab5e-4662-9010-291064f8a79f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.010348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] The token cache is being invalidate because project c8dd530c513745c88112c1a36bf5d263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:05.011261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.013804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.020279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 940/1842] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:04 2022] DELETE /identity/v3/projects/c8dd530c513745c88112c1a36bf5d263 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:05.023265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:05.026481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.031480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839783bf49da4a369f54d3629b8b48fa'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.032389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839783bf49da4a369f54d3629b8b48fa'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.042232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839783bf49da4a369f54d3629b8b48fa'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.054753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839783bf49da4a369f54d3629b8b48fa'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.100045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e7e07368-cc9c-4611-8efd-97add4c4813c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839783bf49da4a369f54d3629b8b48fa'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:05.127109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 903/1843] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:04 2022] DELETE /identity/v3/users/839783bf49da4a369f54d3629b8b48fa => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:05.128395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effbaa-2787-466c-b509-5fbc8d260b1c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.128716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effbaa-2787-466c-b509-5fbc8d260b1c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.129023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effbaa-2787-466c-b509-5fbc8d260b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.188568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-11effbaa-2787-466c-b509-5fbc8d260b1c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:05.197332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-11effbaa-2787-466c-b509-5fbc8d260b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.268713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44587-ab5e-4662-9010-291064f8a79f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:05.435355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:05.455264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 904/1844] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:05.462839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18583a14-231f-4c60-9ceb-6881c8a0ba72 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.463211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18583a14-231f-4c60-9ceb-6881c8a0ba72 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.463436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18583a14-231f-4c60-9ceb-6881c8a0ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.467223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:05.468230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.468598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.469008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.470470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:05.472442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ba819-dc98-497c-8a68-1295e0777c58 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:05.504047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 941/1845] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:05.508313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.509985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.510814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.568326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-18583a14-231f-4c60-9ceb-6881c8a0ba72 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:05.571716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-18583a14-231f-4c60-9ceb-6881c8a0ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.581145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:05.585270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.586900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 905/1846] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:05.595347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.596654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.597146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.630452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:05.633454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.648594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 906/1847] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:05.650242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:05.661558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.672995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:05.676379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 942/1848] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:05.677363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:05.679793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.689595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba447bf-6d8b-485a-8c5d-13646727dd58 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:05.698473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:05.699913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.700187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.700878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] PATH_INFO: `/v3/projects/4681d43af07945b0897b2ace0ea89b17/users/4fc257b655544828905dc6b06f1867e8/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.733222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4681d43af07945b0897b2ace0ea89b17, user_id=4fc257b655544828905dc6b06f1867e8, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:05.737018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:05.762306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 907/1849] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:05 2022] PUT /identity/v3/projects/4681d43af07945b0897b2ace0ea89b17/users/4fc257b655544828905dc6b06f1867e8/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:05.763509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:05.782263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9d4ef-bf85-4acc-9498-c9949638d7a1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:05.899436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0c70-595b-4aaa-9f06-e66cfdfdbb26 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:05.931065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:05.931920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.932252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.932600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.937275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:05.937605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:05.938600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:05.939773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:05.941198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:05.941880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:05.944217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:05.963199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 908/1850] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:05.963199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:05.963199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:05.974333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:05.977107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa91dff-bcda-4680-91c9-5dc8233e3552 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:05.995537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 943/1851] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:06.017439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368420-3861-487a-b452-9f421eeee454 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.017835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368420-3861-487a-b452-9f421eeee454 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.018229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368420-3861-487a-b452-9f421eeee454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.067773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c3368420-3861-487a-b452-9f421eeee454 None None] MFA Rules not processed for user `4fc257b655544828905dc6b06f1867e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:06.069280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c3368420-3861-487a-b452-9f421eeee454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:06.075876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419bd6b-62b6-4b50-ad5b-1519396656a6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.097326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.101658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.103037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.104195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.135610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:06.216890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 944/1852] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:06.219958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3368420-3861-487a-b452-9f421eeee454 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.223490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.226589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.245781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3368420-3861-487a-b452-9f421eeee454 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.246121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 909/1853] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:46:06.247012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.258784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.259607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.260113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.260226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.261797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f0c83-ea29-4bc2-9b7c-a42207279652 service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.263202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.267622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.278598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.279685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.280192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.281421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.282657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.288145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.314010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:06.363670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 945/1854] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:06.366896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.410324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 910/1855] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:06.414945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.496725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2587dd0-d121-4a83-a501-0318372712e7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.559074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b7d2-bbfa-453c-b7fb-c4c56109f2f2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.565531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.566889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.567021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.567246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.567965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.570633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.613027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.614925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.615298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.616829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.618629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.620993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 911/1856] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/users => generated 310 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:06.624820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.626520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.664518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 946/1857] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:06.666125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.666727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865d87-035c-45ec-8967-cdb9a5dca535 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.684489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b982fec-827c-4647-b724-ef61885e1b81 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.688658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.689509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.689799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.690102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.690684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.690810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.691653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.692054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.692475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.693007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.694000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.696001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.713811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 947/1858] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:06.714784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.716900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 912/1859] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:06.720756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.732644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a11a4-7a34-4088-b8b1-a6e873f91dbb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.741761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d8fc-4e38-4b73-a0c3-58ad12a98c81 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.749211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.751115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.751450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.752802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.753647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.754305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.755359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.755652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.756893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] PATH_INFO: `/v3/projects/5feda73fba9548c9b6936968c1d78cb0/users/f7cbd613a6dc429c9e5d6e7e043d16d4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.759320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.776679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 948/1860] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:06.777687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.795091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44289500-542c-40e6-b53e-84e6a7f8a4bc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:06.799646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feda73fba9548c9b6936968c1d78cb0, user_id=f7cbd613a6dc429c9e5d6e7e043d16d4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.802254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:06.802552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.803353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.803661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.803952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] PATH_INFO: `/v3/projects/668e9ee3197f417e9f413e076e327c40/users/949bcceb34e645f4aa98b423d82276a7/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.829885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668e9ee3197f417e9f413e076e327c40, user_id=949bcceb34e645f4aa98b423d82276a7, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:06.832095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 913/1861] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:06 2022] PUT /identity/v3/projects/5feda73fba9548c9b6936968c1d78cb0/users/f7cbd613a6dc429c9e5d6e7e043d16d4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:06.836634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:06.836855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf25a7-9bfa-4e03-ad94-fd484f444666 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:06.889628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 949/1862] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:06 2022] PUT /identity/v3/projects/668e9ee3197f417e9f413e076e327c40/users/949bcceb34e645f4aa98b423d82276a7/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:06.903153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:06.903782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:06.904231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:06.984756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:07.060788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] MFA Rules not processed for user `949bcceb34e645f4aa98b423d82276a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:07.065324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.121488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c81ea-6e0b-4bf2-af5d-a053ddbaa6d4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.248985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:07.269115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.269815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.270102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.270381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.271145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.272303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 950/1863] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:07.273267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.273427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.277553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.316750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff256cd6-2e99-4760-a775-a33b0a1d23b3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.322380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.323479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.323822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.324162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] PATH_INFO: `/v3/projects/d9d7030bfe7747b1a4692da0d26b46ac` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.327111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d7030bfe7747b1a4692da0d26b46ac)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.329911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.340383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 914/1864] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:07.341573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.372622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb5be-b8ef-42cb-a168-72e104ff13f5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.387885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.389027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.389548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.390151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.391250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.394971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.439085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d7030bfe7747b1a4692da0d26b46ac', 'request_id': 'req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.448558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d7030bfe7747b1a4692da0d26b46ac', 'request_id': 'req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.455118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d7030bfe7747b1a4692da0d26b46ac', 'request_id': 'req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.471209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 915/1865] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:07 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:07.471209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.471492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] The token cache is being invalidate because project d9d7030bfe7747b1a4692da0d26b46ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:07.471492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.471492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.473588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 951/1866] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:07 2022] DELETE /identity/v3/projects/d9d7030bfe7747b1a4692da0d26b46ac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:07.474332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.477112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.556669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647a7f-1c5b-4d45-a237-6498baf03949 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.564789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.565718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.565996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.566269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] PATH_INFO: `/v3/projects/5feda73fba9548c9b6936968c1d78cb0/users/f7cbd613a6dc429c9e5d6e7e043d16d4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.568905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feda73fba9548c9b6936968c1d78cb0, user_id=f7cbd613a6dc429c9e5d6e7e043d16d4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.571725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.584835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 916/1867] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:07 2022] PUT /identity/v3/projects/5feda73fba9548c9b6936968c1d78cb0/users/f7cbd613a6dc429c9e5d6e7e043d16d4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:07.585768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.587414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.603760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa588a1-a3b7-455a-a9fc-ae7c624ba77a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.634928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:07.659311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6b28f-f5d0-4760-b7d1-e9169f61e3c0 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.664768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.665794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.666175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.666453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] PATH_INFO: `/v3/users/ad2a7ad26d8f495e9e5181f17054a337` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.667687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2a7ad26d8f495e9e5181f17054a337)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.669657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.675906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.676591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.676875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.677156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.677850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.680608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dab0b7-c0ab-4264-9c31-c6b8b6b47936 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.704732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 952/1868] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:07 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:07.706048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.706350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.706619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.718145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2a7ad26d8f495e9e5181f17054a337'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.718807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2a7ad26d8f495e9e5181f17054a337'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.726988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2a7ad26d8f495e9e5181f17054a337'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.734504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2a7ad26d8f495e9e5181f17054a337'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.736539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:07.737949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] MFA Rules not processed for user `f7cbd613a6dc429c9e5d6e7e043d16d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:07.739361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.751357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2a7ad26d8f495e9e5181f17054a337'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:07.759671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 917/1869] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:07 2022] DELETE /identity/v3/users/ad2a7ad26d8f495e9e5181f17054a337 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:07.762738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.762738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.826744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 953/1870] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:07.839924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.841506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:07.860218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd7b8a-d87a-4ece-a77d-dd049da46136 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.865279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.866206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.866425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.866700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.867522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.869141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.885091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 918/1871] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:07.886551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:07.899163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595036e-3db3-4ca6-9328-2e23d1a7cfc9 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.906601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:07.907868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:07.908305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:07.908743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] PATH_INFO: `/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0/users/efc6e2af58124881a1ddc4fb60b38ec4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:07.928964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978b4a9-a38b-4b96-8f89-57b0ad5bc4f1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:07.932646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d67bfba1e0c44659ba1a694fa6565a0, user_id=efc6e2af58124881a1ddc4fb60b38ec4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:07.936420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:07.966190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 919/1872] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:07 2022] PUT /identity/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0/users/efc6e2af58124881a1ddc4fb60b38ec4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:07.970192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.074744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.075449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.075801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.076084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.088581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2637cfc-7989-4472-9468-7857de6d8a7b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.094550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:08.094765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.095608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.095940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.096265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.097358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.099063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.117516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 920/1873] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:08.118811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.129921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9fb-f63a-43dd-979a-8a11cc3d509c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.143749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.144726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.145014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.145298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] PATH_INFO: `/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0/users/efc6e2af58124881a1ddc4fb60b38ec4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.152500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d67bfba1e0c44659ba1a694fa6565a0, user_id=efc6e2af58124881a1ddc4fb60b38ec4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.155444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.167493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 921/1874] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:08 2022] PUT /identity/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0/users/efc6e2af58124881a1ddc4fb60b38ec4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:08.168478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.170073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.190776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.200011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c4d09-0467-4e88-be81-ade00ec2c493 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.213081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 954/1875] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:07 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:08.215897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.216473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.216764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.253022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:08.291554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] MFA Rules not processed for user `efc6e2af58124881a1ddc4fb60b38ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:08.292871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.301861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c734a7-d26e-46f4-b810-db80ab103932 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.316283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.317581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.317963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.318356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] PATH_INFO: `/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.321963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417d5780b2be4e3f9f75bbeb1eb704ac)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.324088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.409183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 955/1876] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:08.425501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.433206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417d5780b2be4e3f9f75bbeb1eb704ac', 'request_id': 'req-cc85572c-7c0e-4b3f-83d9-80184cd644e1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.440981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417d5780b2be4e3f9f75bbeb1eb704ac', 'request_id': 'req-cc85572c-7c0e-4b3f-83d9-80184cd644e1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.451607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417d5780b2be4e3f9f75bbeb1eb704ac', 'request_id': 'req-cc85572c-7c0e-4b3f-83d9-80184cd644e1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.465168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] The token cache is being invalidate because project 417d5780b2be4e3f9f75bbeb1eb704ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:08.465565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.466193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-cc85572c-7c0e-4b3f-83d9-80184cd644e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.468560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 922/1877] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:08 2022] DELETE /identity/v3/projects/417d5780b2be4e3f9f75bbeb1eb704ac => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:08.473085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.473405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.473693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.495215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:08.496336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.497167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468abe7c-9e6d-475e-a37e-7d4967f0e303 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.544706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:08.549787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.550692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.551153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.551519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.553366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.557977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 923/1878] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:08.559158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.566018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.577560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9314-3aae-4979-9989-9a12c17fa277 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.581213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.581852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.582135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.582413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.584816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.617721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.619182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e83458-8d6e-47f3-a533-b7024329a308 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.631189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 956/1879] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:08.633977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.634923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.635241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.656797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:08.658694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.668717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 957/1880] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:08.670572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.672063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.677354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.682530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 924/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:08.688631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c5579-f12c-4367-adb0-0bdaff8b23cb None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.694416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.697248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:08.697368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.698150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.698230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.698503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.699262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:08.702566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.704685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.731668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 958/1882] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:08.733091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89f37-aea3-4e95-b543-a9faf30bd1da service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.733372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.749283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.750315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.750740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.751023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] PATH_INFO: `/v3/users/949bcceb34e645f4aa98b423d82276a7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.752455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949bcceb34e645f4aa98b423d82276a7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.754485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.756400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcca631-1193-4188-98a4-c2ca099fcd21 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.756605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:08.763169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:08.763498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.763739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.764130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.764939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:08.767313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:08.809698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 959/1883] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:08.811147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:08.844929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949bcceb34e645f4aa98b423d82276a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.845981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949bcceb34e645f4aa98b423d82276a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.864883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949bcceb34e645f4aa98b423d82276a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.880229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949bcceb34e645f4aa98b423d82276a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.899529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ea7fee06-b16a-4265-9270-136f66d05c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949bcceb34e645f4aa98b423d82276a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:08.911960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 925/1884] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:08 2022] DELETE /identity/v3/users/949bcceb34e645f4aa98b423d82276a7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:08.914452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57208-f680-4a67-a858-2386462b8eb2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:08.919343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:08.919343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:08.919343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:08.954088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:08.955393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.002709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.003617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.003908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.004192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.005407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.007940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.017679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:09.040490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 960/1885] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:09.041479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.043375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.055719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec89f-2c5d-4e72-91b9-4f1bc9f6d2ca admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.061268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.061939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.062221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.062496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.063263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.064866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.079944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 926/1886] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:09.087597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 961/1887] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:09.093162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.094977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.104305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.129073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145faf0-9bc4-405a-8cc5-d80593cae46a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.134671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.135376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.135661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.135933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.136689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.138466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.159945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 962/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:09.159945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.169098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61649d68-0a5e-423a-be2d-19801f30321f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.174258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.175733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.176148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.176498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] PATH_INFO: `/v3/projects/1770a390a23d40eaa7aef4ecdbda003c/users/5fabbd3cee3649478d8da2a17baafa73/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.197181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1770a390a23d40eaa7aef4ecdbda003c, user_id=5fabbd3cee3649478d8da2a17baafa73, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.197731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15850f84-1f60-4548-9ab3-89dcaff6bb9c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.201597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91f71-3e2e-4a51-ad78-b4b5e2a8f071 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.202589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.203683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.204207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.205085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.218943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.222425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.236849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 963/1889] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:09 2022] PUT /identity/v3/projects/1770a390a23d40eaa7aef4ecdbda003c/users/5fabbd3cee3649478d8da2a17baafa73/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:09.238603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 927/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:09.246637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.246945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.247278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.288327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] MFA Rules not processed for user `5fabbd3cee3649478d8da2a17baafa73`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:09.290360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.373390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 964/1891] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:09.377818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.399666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b555762-d4b3-487e-9653-d2d5fdda15c8 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.420024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:09.472836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.473517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.473952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.474267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.475794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.478164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.510613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 928/1892] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:09 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:09.512022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.529595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458aca-f8eb-4539-a915-82f9887c4b28 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.589102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.589792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.590111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.590348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.591052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.593245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.613943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 965/1893] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:09 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:09.617987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.628678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c63073-5c0d-4a2d-8bb3-47ca5684ce1d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.634041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.634714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.634999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.635314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.636139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.637844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.649677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 929/1894] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:09.653868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.664472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5047d5f-1fc6-47a1-87fe-ea86f4dad8ee admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.669239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.670142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.670428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.670716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] PATH_INFO: `/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4/users/5f88e58c71e24920ac2279f4b7e180af/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.688326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a57cbc9f3442e289ceaee5cfff81b4, user_id=5f88e58c71e24920ac2279f4b7e180af, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.691082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.705682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 966/1895] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:09 2022] PUT /identity/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4/users/5f88e58c71e24920ac2279f4b7e180af/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:09.710234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.721428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1307f6-6f47-4e31-a2a4-ca1e9fcc8404 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.740651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.743501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.752160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:09.798607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.799369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.799658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.799935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.800721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.802425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.815246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 930/1896] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:09.817254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.824908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e7e3a-ad81-40d2-8958-985eff0cd009 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.827956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75da8-1cb7-4bf2-bf8e-5bfcb162f886 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.829812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.831204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.831492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.831773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] PATH_INFO: `/v3/projects/668e9ee3197f417e9f413e076e327c40` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.832606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:09.833218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=668e9ee3197f417e9f413e076e327c40)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.833602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.833890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.834795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] PATH_INFO: `/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4/users/5f88e58c71e24920ac2279f4b7e180af/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.835979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.836870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a57cbc9f3442e289ceaee5cfff81b4, user_id=5f88e58c71e24920ac2279f4b7e180af, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:09.839567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b885-2257-46cc-b2c9-64065ce1a5cf admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:09.849933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 931/1897] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:09 2022] PUT /identity/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4/users/5f88e58c71e24920ac2279f4b7e180af/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:09.861220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:09.861512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:09.861796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:09.884460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668e9ee3197f417e9f413e076e327c40', 'request_id': 'req-949c5991-c351-4cb9-83b1-f41aee412e54'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:09.888639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] MFA Rules not processed for user `5f88e58c71e24920ac2279f4b7e180af`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:09.889851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.892514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668e9ee3197f417e9f413e076e327c40', 'request_id': 'req-949c5991-c351-4cb9-83b1-f41aee412e54'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:09.899461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668e9ee3197f417e9f413e076e327c40', 'request_id': 'req-949c5991-c351-4cb9-83b1-f41aee412e54'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:09.910734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] The token cache is being invalidate because project 668e9ee3197f417e9f413e076e327c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:09.911023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:09.911709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:09.913583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 967/1898] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:09 2022] DELETE /identity/v3/projects/668e9ee3197f417e9f413e076e327c40 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:09.917441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.918771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.968901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 932/1899] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:09.990082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:09.992259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:09.997043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c5991-c351-4cb9-83b1-f41aee412e54 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:09.999311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:10.003451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:10.004343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.005648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.005648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] PATH_INFO: `/v3/users/efc6e2af58124881a1ddc4fb60b38ec4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.007294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc6e2af58124881a1ddc4fb60b38ec4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:10.009408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:10.054387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:10.066595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239de10-b9eb-40b3-b84d-873ad4e825d2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:10.076341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc6e2af58124881a1ddc4fb60b38ec4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.078795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:10.079509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.079919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.080100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.090806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc6e2af58124881a1ddc4fb60b38ec4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.100889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:10.102607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:10.113127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc6e2af58124881a1ddc4fb60b38ec4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.114174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc6e2af58124881a1ddc4fb60b38ec4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.114384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 933/1900] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:10.123790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db25fd8d-af5a-4925-a9aa-cfdd080ef97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc6e2af58124881a1ddc4fb60b38ec4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.132065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 968/1901] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:09 2022] DELETE /identity/v3/users/efc6e2af58124881a1ddc4fb60b38ec4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:10.190282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:10.196915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.218225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e2387-eaab-431d-aff9-a965f175e880 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:10.314498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:10.315433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.315718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.315998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] PATH_INFO: `/v3/users/5fabbd3cee3649478d8da2a17baafa73` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.317680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fabbd3cee3649478d8da2a17baafa73)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:10.319682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:10.436992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fabbd3cee3649478d8da2a17baafa73'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.439363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fabbd3cee3649478d8da2a17baafa73'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.451197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fabbd3cee3649478d8da2a17baafa73'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.473262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fabbd3cee3649478d8da2a17baafa73'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.494982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fabbd3cee3649478d8da2a17baafa73'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.510205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 934/1902] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:10 2022] DELETE /identity/v3/users/5fabbd3cee3649478d8da2a17baafa73 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:10.515094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e7eb-accb-448c-a136-666abd227aea None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.515396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e7eb-accb-448c-a136-666abd227aea None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.515691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e7eb-accb-448c-a136-666abd227aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.543708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-4711e7eb-accb-448c-a136-666abd227aea None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:10.545352 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4711e7eb-accb-448c-a136-666abd227aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.648037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 969/1903] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:10.657559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:10.658997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.664393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e7eb-accb-448c-a136-666abd227aea None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:10.666351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4711e7eb-accb-448c-a136-666abd227aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.695043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e7eb-accb-448c-a136-666abd227aea None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:10.711349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:10.712382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.712582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.712861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] PATH_INFO: `/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.714912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d67bfba1e0c44659ba1a694fa6565a0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:10.716916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:10.762904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:10.797992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052b030-0948-4264-b8ab-475e89439691 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:10.810137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d67bfba1e0c44659ba1a694fa6565a0', 'request_id': 'req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.818674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d67bfba1e0c44659ba1a694fa6565a0', 'request_id': 'req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.825884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d67bfba1e0c44659ba1a694fa6565a0', 'request_id': 'req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.839577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] The token cache is being invalidate because project 4d67bfba1e0c44659ba1a694fa6565a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:10.840375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.840541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7d6c3f3e-0757-4866-8ac7-c671fc141cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:10.846271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 970/1904] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:10 2022] DELETE /identity/v3/projects/4d67bfba1e0c44659ba1a694fa6565a0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:10.847885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3051-08a0-4aee-978b-70aad423f551 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.848783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3051-08a0-4aee-978b-70aad423f551 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.849081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3051-08a0-4aee-978b-70aad423f551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.867506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:10.868190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.868473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.868749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.869065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-69ee3051-08a0-4aee-978b-70aad423f551 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:10.870332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-69ee3051-08a0-4aee-978b-70aad423f551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.871068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.906424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:10.941514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 971/1905] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:10.942907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:10.945031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:10.950991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:10.951411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:10.951697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:10.955562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 935/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:10.969629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:10.970830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:10.978790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 972/1907] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:10.983763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:10.994777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63575-6c24-4e41-bdd5-f9c119b79a07 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.000423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.001424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.001710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.002108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.003049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:11.003411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.005026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.023703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 936/1908] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:11.028251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.038888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0dafe-8689-4a86-876c-64ffb1cd0c75 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.043803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.044549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.044905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.045251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.046018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.048193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.080593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 973/1909] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:11 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:11.086046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.097780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f34c-3321-437d-b9c2-ac2a5f5bf779 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.194455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.195161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.195444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.195726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.197038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.198979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.227531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.229024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 937/1910] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:11 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:11.240020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e766-56f6-4cbc-8c99-aa1e99333b92 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.248259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.249513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.250036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.250696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.251837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.254317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.264964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.267014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:11.274086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 974/1911] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:11.275494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.287986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9179c8-d559-4f7a-a422-2bb60c8e2483 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.294399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.295463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.295810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.296871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] PATH_INFO: `/v3/projects/1770a390a23d40eaa7aef4ecdbda003c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.298187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1770a390a23d40eaa7aef4ecdbda003c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.300383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.304478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:11.323157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c20f3-e439-437d-b3c5-bfda1e998507 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.333841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.335098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.335420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.335698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.336593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.341679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.361948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 975/1912] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:11.363466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.365995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1770a390a23d40eaa7aef4ecdbda003c', 'request_id': 'req-a325af77-169e-4036-a57d-05103ec0f8a1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.373561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1770a390a23d40eaa7aef4ecdbda003c', 'request_id': 'req-a325af77-169e-4036-a57d-05103ec0f8a1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.382746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1770a390a23d40eaa7aef4ecdbda003c', 'request_id': 'req-a325af77-169e-4036-a57d-05103ec0f8a1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.384138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb9d29-248c-425f-930a-a6a6d6005036 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.427219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] The token cache is being invalidate because project 1770a390a23d40eaa7aef4ecdbda003c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:11.427219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.427219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.427219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 938/1913] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:11 2022] DELETE /identity/v3/projects/1770a390a23d40eaa7aef4ecdbda003c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:11.432408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.434872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:11.458491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.460022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.460289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.460565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] PATH_INFO: `/v3/projects/733addb8c09c4ac1871ae6d476888c0f/users/df821f29d07b4df28c4d18b43bc70c6c/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.476262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733addb8c09c4ac1871ae6d476888c0f, user_id=df821f29d07b4df28c4d18b43bc70c6c, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.481989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84cf3b-f9f1-4116-afff-9b69c8db41b2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.496859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 976/1914] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:11 2022] PUT /identity/v3/projects/733addb8c09c4ac1871ae6d476888c0f/users/df821f29d07b4df28c4d18b43bc70c6c/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:11.505436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325af77-169e-4036-a57d-05103ec0f8a1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.507622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.508004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.508363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.536826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] MFA Rules not processed for user `df821f29d07b4df28c4d18b43bc70c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:11.539381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:11.582418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.583466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.583748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.584096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] PATH_INFO: `/v3/users/5f88e58c71e24920ac2279f4b7e180af` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.585795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f88e58c71e24920ac2279f4b7e180af)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.587889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.612925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:11.623861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 977/1915] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:11.625225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.626634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:11.640649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:11.642534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6c03d-7779-46ce-8a77-ef99f9285459 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.647879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.648551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.648836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.649145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.649834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.649953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f88e58c71e24920ac2279f4b7e180af'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.650740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f88e58c71e24920ac2279f4b7e180af'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.651752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.660844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f88e58c71e24920ac2279f4b7e180af'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.669721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f88e58c71e24920ac2279f4b7e180af'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.684810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 978/1916] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:11 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:11.685747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f88e58c71e24920ac2279f4b7e180af'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:11.686079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.687900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:11.698412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 939/1917] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:11 2022] DELETE /identity/v3/users/5f88e58c71e24920ac2279f4b7e180af => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:11.829754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381a604-f5fa-45de-aeda-f0c5cedc1024 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:11.924381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:11.925070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:11.925353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:11.925629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:11.926324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:11.931683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:11.977371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 979/1918] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:11 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:11.979477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:11.998256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7667-e695-4f18-b316-9d4598547fcb admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.011463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.014039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.014039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.014039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.016306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.023520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.052174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 940/1919] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:12.052335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.066503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769615b-1bf7-4e03-80dd-18fd07256798 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.077294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.079875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.080166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.080450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] PATH_INFO: `/v3/projects/0e64dacd205248dea97f4a755607b625/users/cd26f2731b4a4e0b861bbd9661f425e6/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.118145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e64dacd205248dea97f4a755607b625, user_id=cd26f2731b4a4e0b861bbd9661f425e6, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.125774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.155368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 980/1920] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:12 2022] PUT /identity/v3/projects/0e64dacd205248dea97f4a755607b625/users/cd26f2731b4a4e0b861bbd9661f425e6/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:12.160291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.174944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7749df-647c-46cb-99c2-87610ba0475b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.315172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.315955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.323363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.323363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.323363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.323778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.347099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.348858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 941/1921] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:12.352987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.353883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.368268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242837c-8044-4495-a08d-a01010a01a1c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.376370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.377852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ede87-f525-4272-985e-46e6655b0622 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.378480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.378852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.379269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] PATH_INFO: `/v3/projects/0e64dacd205248dea97f4a755607b625/users/cd26f2731b4a4e0b861bbd9661f425e6/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.383360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e64dacd205248dea97f4a755607b625, user_id=cd26f2731b4a4e0b861bbd9661f425e6, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.386651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a26129-a745-4198-9934-43fbaf34ebd2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.388855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.392877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.393219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.393440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] PATH_INFO: `/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.396277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a57cbc9f3442e289ceaee5cfff81b4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.400563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.405706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 942/1922] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:12 2022] PUT /identity/v3/projects/0e64dacd205248dea97f4a755607b625/users/cd26f2731b4a4e0b861bbd9661f425e6/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:12.417950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.418628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.419165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.467027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] MFA Rules not processed for user `cd26f2731b4a4e0b861bbd9661f425e6`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:12.468609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.474898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:12.480345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a57cbc9f3442e289ceaee5cfff81b4', 'request_id': 'req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:12.494786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a57cbc9f3442e289ceaee5cfff81b4', 'request_id': 'req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:12.513016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a57cbc9f3442e289ceaee5cfff81b4', 'request_id': 'req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:12.535127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] The token cache is being invalidate because project b9a57cbc9f3442e289ceaee5cfff81b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:12.535416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:12.536245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a5f4fc2f-3441-4bc2-b3c2-e162ef9ad779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:12.544442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 981/1923] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:12 2022] DELETE /identity/v3/projects/b9a57cbc9f3442e289ceaee5cfff81b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:12.546321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a06e6-b906-4cc2-a2b6-c8df92f727b3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.546818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a06e6-b906-4cc2-a2b6-c8df92f727b3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.547222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a06e6-b906-4cc2-a2b6-c8df92f727b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.572809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b55a06e6-b906-4cc2-a2b6-c8df92f727b3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:12.574212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b55a06e6-b906-4cc2-a2b6-c8df92f727b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.578270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 943/1924] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:12.586311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.592790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.643706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:12.660630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 982/1925] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:12.668759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.669216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.669501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.688072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:12.689268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.696225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f9ad-92a7-4274-8f67-67b0384036d7 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.697358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 983/1926] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:12.699971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.700624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.700905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.701187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.701402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.710758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3507-d3f9-4515-9934-fadd70816681 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.712602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.714046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.715553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.716212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.716496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.716774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.717499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:12.717806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.719411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.724277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 944/1927] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:12.732332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 984/1928] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:46:12.736564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.755362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df71dfb-03f9-445a-9083-27e795ba7ab9 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.760760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.761549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.761834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.762113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.762814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.764802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.795170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 945/1929] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:12 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:12.798823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.811095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b2871-03fc-4e5f-9c1c-6ab833c9f598 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.835423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.876681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.877266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.877560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.877840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.878553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.880556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.896084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2c90-3c0b-423f-b876-76f48e8293f0 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.899761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.900417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.900703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.900798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 985/1930] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:12 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:12.900981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.902877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:12.904773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.919048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016190c-f4b7-4861-bcc5-2033515229b6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.926442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.927379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.928497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.928997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.930020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.931761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.943019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 986/1931] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:12.948591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.960495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead55d7-b758-475b-b226-4cff99bbe2cc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:12.966018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:12.966694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:12.966983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:12.967295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:12.968022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:12.969621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:12.983003 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 987/1932] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:12.987607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:12.998277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.000155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b24cd-1ccd-4027-ba56-17a7bbe07418 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.000626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd6ccd-511e-4219-997b-fd9b2e461ed7 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.005743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.006973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.007373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.007757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] PATH_INFO: `/v3/projects/32b9de5c173440adb4610ae476d2aaff/users/b0256016c4bf4f95a639ae45a86a8b84/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.012433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 946/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:13.033541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9de5c173440adb4610ae476d2aaff, user_id=b0256016c4bf4f95a639ae45a86a8b84, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.036342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.041054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:13.075183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 988/1934] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:12 2022] PUT /identity/v3/projects/32b9de5c173440adb4610ae476d2aaff/users/b0256016c4bf4f95a639ae45a86a8b84/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:13.086392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.086978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.087495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.124101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] MFA Rules not processed for user `b0256016c4bf4f95a639ae45a86a8b84`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:13.125480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:13.176076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:13.222675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 947/1935] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:13.228187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.313248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0df10-92f2-4701-9454-1e1064421311 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.319648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.320550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.321582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.321977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.322818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.324979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.398964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 989/1936] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:13 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:13.403865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.417938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97708-c767-4332-9256-5c3c58d05784 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.528788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.531831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.532126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.532453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.533183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.535124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.568878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 948/1937] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:13 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:13.573131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.608755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452806a4-68bf-4c5f-aa4e-90db046f2e55 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.615171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.616640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.617164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.617454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.618204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.629207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.658900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.659042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 990/1938] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:13.676140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b91777-e8ef-4fd1-bb13-a8c100a6fa27 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.682825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.683785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.684072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.684352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] PATH_INFO: `/v3/projects/02bb2fb401e848fe86319082f3904794/users/79d2ade1cacb4cb7a270c06c753aa927/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.703032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bb2fb401e848fe86319082f3904794, user_id=79d2ade1cacb4cb7a270c06c753aa927, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.707252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.725565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 949/1939] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:13 2022] PUT /identity/v3/projects/02bb2fb401e848fe86319082f3904794/users/79d2ade1cacb4cb7a270c06c753aa927/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:13.729710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.741704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04766e-f4e0-434d-9c67-4f33c8e1ccac admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.808826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.809546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.809828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.810150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.810926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.812575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368bb77-b5a3-48af-a6ff-16d3152b8bdb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.823474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 991/1940] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:13.827689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:13.840604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fcdd-d47c-4436-8843-0fba84f85d04 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:13.846259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:13.847488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.847847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.848194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] PATH_INFO: `/v3/projects/02bb2fb401e848fe86319082f3904794/users/79d2ade1cacb4cb7a270c06c753aa927/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.851069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bb2fb401e848fe86319082f3904794, user_id=79d2ade1cacb4cb7a270c06c753aa927, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:13.854236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:13.866281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 950/1941] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:13 2022] PUT /identity/v3/projects/02bb2fb401e848fe86319082f3904794/users/79d2ade1cacb4cb7a270c06c753aa927/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:13.877613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:13.877903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:13.878180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:13.906889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] MFA Rules not processed for user `79d2ade1cacb4cb7a270c06c753aa927`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:13.908154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:13.967391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:13.991409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 992/1942] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:14.002504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:14.005212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.066731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c340058-c79d-4700-84fb-913731714ff3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:14.071290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:14.071797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.072165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.072350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.081814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:14.083200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219846e-776f-4423-ad99-be2a33ea691e service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:14.094308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 951/1943] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:14.238356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:14.298763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177265f-4194-4a6d-acef-8ac54071177c None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.299489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177265f-4194-4a6d-acef-8ac54071177c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.300170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177265f-4194-4a6d-acef-8ac54071177c None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.302007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 952/1944] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:46:14.317094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47227-294d-4e98-bc75-66c769cac46e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.317706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47227-294d-4e98-bc75-66c769cac46e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.317969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47227-294d-4e98-bc75-66c769cac46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.336627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de7bd0-57b5-4648-bfd6-a9b75cfa72ae None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:14.345756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:14.347781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b9c47227-294d-4e98-bc75-66c769cac46e None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:14.347924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.348215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.348503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] PATH_INFO: `/v3/users/b0256016c4bf4f95a639ae45a86a8b84` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.351308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b9c47227-294d-4e98-bc75-66c769cac46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.352284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0256016c4bf4f95a639ae45a86a8b84)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:14.355576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:14.404137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:14.460260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0256016c4bf4f95a639ae45a86a8b84'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:14.469777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0256016c4bf4f95a639ae45a86a8b84'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:14.471110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 953/1945] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:14.484823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0256016c4bf4f95a639ae45a86a8b84'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:14.485592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0256016c4bf4f95a639ae45a86a8b84'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:14.493525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0256016c4bf4f95a639ae45a86a8b84'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:14.499741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 993/1946] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:14 2022] DELETE /identity/v3/users/b0256016c4bf4f95a639ae45a86a8b84 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:14.504481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.505256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.505549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.526373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:14.527619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.535429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:14.537952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.681811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 954/1947] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:14.718875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ce1b-d49e-4023-8a43-aa1fe8f781c7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:14.734196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:14.735615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.735615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.736143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.738622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.767177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:14.769316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:14.789653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:14.808024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:14.812189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:14.856607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 994/1948] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:14.905661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f34ef0-cde3-4331-8996-42e811173b84 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:14.913836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:14.926720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:14.929438 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:14.929846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:14.952826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:14.956076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024f522-a603-4b22-aaed-48707b3f5a12 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:15.017870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 955/1949] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:15.133461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:15.137493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.165637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee30e4a-68a9-4626-964e-6c2e8b646cf5 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:15.185096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:15.186010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:15.186430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:15.186788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] PATH_INFO: `/v3/users/4fc257b655544828905dc6b06f1867e8` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:15.188636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc257b655544828905dc6b06f1867e8)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:15.195541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:15.312156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc257b655544828905dc6b06f1867e8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.322017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc257b655544828905dc6b06f1867e8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.382105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc257b655544828905dc6b06f1867e8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.383341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc257b655544828905dc6b06f1867e8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.403870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc257b655544828905dc6b06f1867e8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.421937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 995/1950] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:15 2022] DELETE /identity/v3/users/4fc257b655544828905dc6b06f1867e8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:15.426489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:15.426870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:15.427254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:15.458837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:15.461163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.523856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:15.525579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.619187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bf7ea-7096-4da4-9a42-50927e5deda2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:15.625450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:15.626534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:15.627365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:15.627756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] PATH_INFO: `/v3/projects/32b9de5c173440adb4610ae476d2aaff` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:15.629476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b9de5c173440adb4610ae476d2aaff)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:15.633531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:15.666342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 956/1951] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:15.691481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:15.703798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.721459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:15.727504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b9de5c173440adb4610ae476d2aaff', 'request_id': 'req-56209136-dc7f-4369-aeab-9141cf536334'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.740025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b9de5c173440adb4610ae476d2aaff', 'request_id': 'req-56209136-dc7f-4369-aeab-9141cf536334'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.755110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b9de5c173440adb4610ae476d2aaff', 'request_id': 'req-56209136-dc7f-4369-aeab-9141cf536334'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.769803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:15.780746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] The token cache is being invalidate because project 32b9de5c173440adb4610ae476d2aaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:15.782286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.785650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.794097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 996/1952] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:15 2022] DELETE /identity/v3/projects/32b9de5c173440adb4610ae476d2aaff => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:15.795589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfa274-98d8-47ad-a977-0cbadb227f04 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:15.795874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:15.798625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.878711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:15.879177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:15.879386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:15.879665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:15.882342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:15.883921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56209136-dc7f-4369-aeab-9141cf536334 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:15.889725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:15.890696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:15.891359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:15.891832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] PATH_INFO: `/v3/users/79d2ade1cacb4cb7a270c06c753aa927` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:15.893852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d2ade1cacb4cb7a270c06c753aa927)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:15.894807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:15.896271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:15.897188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:15.909189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 957/1953] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:15.948279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d2ade1cacb4cb7a270c06c753aa927'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.955671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d2ade1cacb4cb7a270c06c753aa927'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.968860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d2ade1cacb4cb7a270c06c753aa927'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.969592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d2ade1cacb4cb7a270c06c753aa927'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.981611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d2ade1cacb4cb7a270c06c753aa927'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:15.990695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 997/1954] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:15 2022] DELETE /identity/v3/users/79d2ade1cacb4cb7a270c06c753aa927 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:16.336588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:16.340428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.356210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5025-90a3-492e-b30a-60d94aa379e0 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:16.417052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:16.417953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.418240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.418653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] PATH_INFO: `/v3/users/df821f29d07b4df28c4d18b43bc70c6c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.419970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df821f29d07b4df28c4d18b43bc70c6c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:16.422284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:16.478522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:16.481379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.499494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df821f29d07b4df28c4d18b43bc70c6c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.500177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df821f29d07b4df28c4d18b43bc70c6c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.509195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df821f29d07b4df28c4d18b43bc70c6c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.517598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529eef-525c-438c-a8ab-ef9d2f255650 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:16.518819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df821f29d07b4df28c4d18b43bc70c6c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.523655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:16.524628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.524793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.525072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] PATH_INFO: `/v3/projects/02bb2fb401e848fe86319082f3904794` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.526292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bb2fb401e848fe86319082f3904794)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:16.528163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:16.528897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:16.536127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df821f29d07b4df28c4d18b43bc70c6c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.543482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 958/1955] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:16 2022] DELETE /identity/v3/users/df821f29d07b4df28c4d18b43bc70c6c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:16.544351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:16.545941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.581682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bb2fb401e848fe86319082f3904794', 'request_id': 'req-40251240-7592-41b0-bdd7-851138037b04'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.589821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bb2fb401e848fe86319082f3904794', 'request_id': 'req-40251240-7592-41b0-bdd7-851138037b04'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.595680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bb2fb401e848fe86319082f3904794', 'request_id': 'req-40251240-7592-41b0-bdd7-851138037b04'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.604572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:16.608919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] The token cache is being invalidate because project 02bb2fb401e848fe86319082f3904794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:16.609264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.610435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-40251240-7592-41b0-bdd7-851138037b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.612750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 998/1956] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:16 2022] DELETE /identity/v3/projects/02bb2fb401e848fe86319082f3904794 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:16.614624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4828-f8be-4683-8306-28bf76179f42 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.614934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4828-f8be-4683-8306-28bf76179f42 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.617023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4828-f8be-4683-8306-28bf76179f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.619848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4faf-4236-46e8-ae5a-2f6e4d36c2f2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:16.634816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-da8d4828-f8be-4683-8306-28bf76179f42 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:16.636111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-da8d4828-f8be-4683-8306-28bf76179f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.676643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:16.677513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.678654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.678942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] PATH_INFO: `/v3/projects/4681d43af07945b0897b2ace0ea89b17` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.680204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4681d43af07945b0897b2ace0ea89b17)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:16.682152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:16.705277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 999/1957] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:16.706666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.706964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.707289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.753066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:16.755945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.760034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4681d43af07945b0897b2ace0ea89b17', 'request_id': 'req-fecd8403-e4fe-4637-a80b-c139ff123326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.767390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4681d43af07945b0897b2ace0ea89b17', 'request_id': 'req-fecd8403-e4fe-4637-a80b-c139ff123326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.780571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4681d43af07945b0897b2ace0ea89b17', 'request_id': 'req-fecd8403-e4fe-4637-a80b-c139ff123326'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.794758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] The token cache is being invalidate because project 4681d43af07945b0897b2ace0ea89b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:16.795184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.795965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:16.797749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 959/1958] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:16 2022] DELETE /identity/v3/projects/4681d43af07945b0897b2ace0ea89b17 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:16.798516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:16.800646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.842964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1000/1959] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:16.844012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:16.845350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.857113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:16.860555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6409a-cfde-41af-a41e-b45ede5a8f65 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:16.867506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:16.868575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.869029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.869639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] PATH_INFO: `/v3/users/f7cbd613a6dc429c9e5d6e7e043d16d4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.870973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cbd613a6dc429c9e5d6e7e043d16d4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:16.874016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:16.915454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8403-e4fe-4637-a80b-c139ff123326 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:16.945721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:16.946901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:16.948653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:16.949434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:16.956636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:16.980090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:16.982224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12c4a7-afdd-401e-bb61-8c24aa003a29 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.002697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cbd613a6dc429c9e5d6e7e043d16d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.026583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 960/1960] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:17.032649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.033161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.033569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.036777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cbd613a6dc429c9e5d6e7e043d16d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.066199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cbd613a6dc429c9e5d6e7e043d16d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.067066 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cbd613a6dc429c9e5d6e7e043d16d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.078299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cbd613a6dc429c9e5d6e7e043d16d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.084682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:17.089006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1001/1961] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:16 2022] DELETE /identity/v3/users/f7cbd613a6dc429c9e5d6e7e043d16d4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:17.089148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.230105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 961/1962] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:17.231396 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.257958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3bff-a37b-45c6-926b-5f6d599d8f91 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.277047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.296099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.296452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.296753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.301149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:17.301149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.308762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.330295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:17.350020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1002/1963] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:46:17.353883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.368347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf40a-62c0-419f-a4ce-12ac3b9eb351 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.382857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.383858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.384183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.384428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.385184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.387259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.441193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 962/1964] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:17 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:17.445934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.453729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.457163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.462345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be3e3-212a-49ab-aeaf-cc92bf4ef50f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.593463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.594554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.595084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.595478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.597193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.600319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.601953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659d341-92bb-439d-8bec-949dcd2911d3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.616137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.617026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.617312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.617589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] PATH_INFO: `/v3/users/73e6f81931eb49e6a9e984cd53778cc3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.618958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e6f81931eb49e6a9e984cd53778cc3)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.621262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.652180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1003/1965] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:17 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:17.653339 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.666010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257d88b-d934-4c92-ac93-4ef9e2b218c3 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.673029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.673937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.674525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.675047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.676197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.679111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.695160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1004/1966] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:17.696410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.697718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e6f81931eb49e6a9e984cd53778cc3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.698808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e6f81931eb49e6a9e984cd53778cc3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.701977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:17.710350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec134-9ec6-42d5-810e-6834356accf5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.710530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e6f81931eb49e6a9e984cd53778cc3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.717037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.717948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.718243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.718597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.719696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.721957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e6f81931eb49e6a9e984cd53778cc3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.741019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.742255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61ec4001-d4f8-4d8a-be19-c62b4f30d011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e6f81931eb49e6a9e984cd53778cc3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:17.754453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 963/1967] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:17 2022] DELETE /identity/v3/users/73e6f81931eb49e6a9e984cd53778cc3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:17.758049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.758347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.758628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.767234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1005/1968] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:17.770368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.772733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.784498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:17.788201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.788373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8190-7231-4595-925b-4cbed14b938f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.875879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.877074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.877363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.877646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] PATH_INFO: `/v3/projects/96ef75a2f54b42ba934b3ec654f72f44/users/f92d35a91178444ebb1190dbdc42c9d1/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.892209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 964/1969] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:17.895512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.896387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.914005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ef75a2f54b42ba934b3ec654f72f44, user_id=f92d35a91178444ebb1190dbdc42c9d1, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.916941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:17.925212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6ded-0238-4f59-a282-ad26e7607cc8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:17.939578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:17.940167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1006/1970] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:17 2022] PUT /identity/v3/projects/96ef75a2f54b42ba934b3ec654f72f44/users/f92d35a91178444ebb1190dbdc42c9d1/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:17.941172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:17.941677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:17.942200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:17.942718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] PATH_INFO: `/v3/projects/733addb8c09c4ac1871ae6d476888c0f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:17.949212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733addb8c09c4ac1871ae6d476888c0f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:17.950321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:17.954228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.029592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733addb8c09c4ac1871ae6d476888c0f', 'request_id': 'req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.036062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733addb8c09c4ac1871ae6d476888c0f', 'request_id': 'req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.046589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733addb8c09c4ac1871ae6d476888c0f', 'request_id': 'req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.059901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8b8-5951-4b75-96f7-75b334e6d6b4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.062870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] The token cache is being invalidate because project 733addb8c09c4ac1871ae6d476888c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:18.063319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.064073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-61b4485e-fd1c-4ae8-8f2c-1f095a10a754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.069753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 965/1971] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:17 2022] DELETE /identity/v3/projects/733addb8c09c4ac1871ae6d476888c0f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:18.069753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.069753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.069753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.071614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:18.108419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] MFA Rules not processed for user `f92d35a91178444ebb1190dbdc42c9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:18.109627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.143382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.144063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.144353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.144640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.147882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.178427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:18.226633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 966/1972] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:18.227606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.228964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.230379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.232135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.243866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1007/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:18.245201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.246228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2ce78-6ac4-43ee-9342-3a2e96205554 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.247268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.260442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6eb02-c2fb-463f-b4bf-ac782928df7f service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.263402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.264317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.264667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.264890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] PATH_INFO: `/v3/projects/5feda73fba9548c9b6936968c1d78cb0` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.266114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5feda73fba9548c9b6936968c1d78cb0)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.268054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.268180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.269420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.269420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.269757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] PATH_INFO: `/v3/users/cd26f2731b4a4e0b861bbd9661f425e6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.270975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd26f2731b4a4e0b861bbd9661f425e6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.274326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.327303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5feda73fba9548c9b6936968c1d78cb0', 'request_id': 'req-27b0a176-0394-4476-985b-c5704d152f2e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.327883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd26f2731b4a4e0b861bbd9661f425e6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.340019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd26f2731b4a4e0b861bbd9661f425e6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.340620 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5feda73fba9548c9b6936968c1d78cb0', 'request_id': 'req-27b0a176-0394-4476-985b-c5704d152f2e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.355645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd26f2731b4a4e0b861bbd9661f425e6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.356709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd26f2731b4a4e0b861bbd9661f425e6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.357998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5feda73fba9548c9b6936968c1d78cb0', 'request_id': 'req-27b0a176-0394-4476-985b-c5704d152f2e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.364778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd26f2731b4a4e0b861bbd9661f425e6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.371927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1008/1974] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:18 2022] DELETE /identity/v3/users/cd26f2731b4a4e0b861bbd9661f425e6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:18.373221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] The token cache is being invalidate because project 5feda73fba9548c9b6936968c1d78cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:18.373724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.374654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-27b0a176-0394-4476-985b-c5704d152f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:18.375734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.376892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 967/1975] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:18 2022] DELETE /identity/v3/projects/5feda73fba9548c9b6936968c1d78cb0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:18.377244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.390206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a272bc-8940-441f-ade0-d1f08bf4f21a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.391742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a272bc-8940-441f-ade0-d1f08bf4f21a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.392067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a272bc-8940-441f-ade0-d1f08bf4f21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.434253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a2a272bc-8940-441f-ade0-d1f08bf4f21a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:18.435527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a2a272bc-8940-441f-ade0-d1f08bf4f21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.440990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:18.499445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ba87a-83ac-4562-83e6-060c81383b41 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.505002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.506845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.507169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.507458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.508167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.510629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.541867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 968/1976] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:18.549883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.550399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.550650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.565504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1009/1977] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:18.567284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.568817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.573234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:18.574766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:18.648753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 969/1978] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:18.653051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.659986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:18.664895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf3b9-2f0c-410c-b34d-e2c3b84695d0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.665106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d8325-c4ba-4747-88ca-9de07e49df7d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.670946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.672110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.672351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.672732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.673153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.673265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.673732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.674177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.674446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.675100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:18.675562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.677109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.677467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.711326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 970/1979] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:46:18.715060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.718306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1010/1980] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:18.723048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.726946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2538f0-1c91-4c0f-ab37-d3de9f8f6891 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.732815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.733492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.733772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.734049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.734748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.736058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c341f-7996-4eee-840c-269a383554cc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.736856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.741583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.742398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.742783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.743194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.744050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.745771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.760563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1011/1981] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:18.761815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.774170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f2af2-c571-419c-924e-8a8ee34f8db6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.780678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.781732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.782114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.782492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] PATH_INFO: `/v3/projects/0243daa72d6f4da9b49930ee682f3d04/users/d9219b99733d44da9d30c30a278fb37f/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.787880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 971/1982] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/projects => generated 361 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:18.792156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.802362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0243daa72d6f4da9b49930ee682f3d04, user_id=d9219b99733d44da9d30c30a278fb37f, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.806442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.851592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1012/1983] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:18 2022] PUT /identity/v3/projects/0243daa72d6f4da9b49930ee682f3d04/users/d9219b99733d44da9d30c30a278fb37f/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:18.856299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.904145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c2a2f-7d77-4562-9cb5-23bce54871a4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.961324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b08-9bfb-425c-a658-2f4e1d5207ac admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:18.966786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:18.967512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:18.967801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:18.968083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:18.968868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:18.973670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:18.988234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1013/1984] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:18.990822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:18.995489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.009849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:19.014999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278958a0-4814-438c-aadc-01b5bb1cc5a6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.021718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.021891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.022364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.022473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.022737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.022836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.023024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] PATH_INFO: `/v3/projects/4d6e1423f31e4237b4b029f82baa7b35` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.023820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.024105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.024314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6e1423f31e4237b4b029f82baa7b35)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.026702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.026793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.055121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 972/1985] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:18 2022] POST /identity/v3/users => generated 281 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:19.055121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.064975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a873-0c37-48b0-a342-7c7221fadbaa admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.070796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.071867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.072207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.072491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] PATH_INFO: `/v3/projects/0243daa72d6f4da9b49930ee682f3d04/users/d9219b99733d44da9d30c30a278fb37f/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.075617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0243daa72d6f4da9b49930ee682f3d04, user_id=d9219b99733d44da9d30c30a278fb37f, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.078435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.084492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6e1423f31e4237b4b029f82baa7b35', 'request_id': 'req-a9996705-314c-42d0-bd43-fafc54356371'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.092542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 973/1986] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:19 2022] PUT /identity/v3/projects/0243daa72d6f4da9b49930ee682f3d04/users/d9219b99733d44da9d30c30a278fb37f/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:19.093371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.101399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6e1423f31e4237b4b029f82baa7b35', 'request_id': 'req-a9996705-314c-42d0-bd43-fafc54356371'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.109205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6e1423f31e4237b4b029f82baa7b35', 'request_id': 'req-a9996705-314c-42d0-bd43-fafc54356371'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.125480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] The token cache is being invalidate because project 4d6e1423f31e4237b4b029f82baa7b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:19.125480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.127440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a9996705-314c-42d0-bd43-fafc54356371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.130234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1014/1987] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:18 2022] DELETE /identity/v3/projects/4d6e1423f31e4237b4b029f82baa7b35 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:19.135731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.136029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.136471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.165653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:19.175252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] MFA Rules not processed for user `d9219b99733d44da9d30c30a278fb37f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:19.176641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.188785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3f06-867e-4029-b6cb-0ead896ad6c1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.195818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.196680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.197116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.197571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.198459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.200806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.231640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 974/1988] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:19.231640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.232450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.247532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178414-7813-4ef7-9f3f-1f24aca7132f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.252659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.253850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.254615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.254615 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] PATH_INFO: `/v3/users/7f8f594b51554603863b9bb880a71a12` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.256366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8f594b51554603863b9bb880a71a12)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.258871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.279210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1015/1989] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:19.279891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.284312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.300426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba944e5-33af-4092-9d55-a240640ce9b5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.308286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.309327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.311177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.311177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] PATH_INFO: `/v3/projects/0e64dacd205248dea97f4a755607b625` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.311479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e64dacd205248dea97f4a755607b625)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.314332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.359277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8f594b51554603863b9bb880a71a12'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.360802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8f594b51554603863b9bb880a71a12'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.373995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8f594b51554603863b9bb880a71a12'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.384545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8f594b51554603863b9bb880a71a12'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.396651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e64dacd205248dea97f4a755607b625', 'request_id': 'req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.408070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8f594b51554603863b9bb880a71a12'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.408891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e64dacd205248dea97f4a755607b625', 'request_id': 'req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.419218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 975/1990] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:19 2022] DELETE /identity/v3/users/7f8f594b51554603863b9bb880a71a12 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:19.420356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.423522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e64dacd205248dea97f4a755607b625', 'request_id': 'req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.425271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.427416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:19.443770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] The token cache is being invalidate because project 0e64dacd205248dea97f4a755607b625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:19.444198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.444900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:19.447118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1016/1991] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:19 2022] DELETE /identity/v3/projects/0e64dacd205248dea97f4a755607b625 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:19.448464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.451699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.556807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee7dbd-b86c-4001-b72d-32da2e1715e1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.570214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c8d8-3b0e-426f-b4da-4adf49cd95c1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.572289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.574041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.574791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.576238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.577821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.582750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960ac7e-5c3e-419c-9716-83fb920425e5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.613621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 976/1992] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:19.621008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.622844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.623277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.659953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:19.661154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.676417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 977/1993] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:19.676417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.676676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.676676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.676676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.676676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.678784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.679006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.694121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc460f-3787-4999-8d7a-791268a09577 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.701210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.705906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.706430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.706780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] PATH_INFO: `/v3/projects/1365cc615d8d4cebb9c5dfdb005e05d2/users/b56fa2e7388e4967a35b4257798825b0/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.731780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1365cc615d8d4cebb9c5dfdb005e05d2, user_id=b56fa2e7388e4967a35b4257798825b0, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.736134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28ff55-8cf7-4736-879b-2c35962cc0bd admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.755556 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 978/1994] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:19 2022] PUT /identity/v3/projects/1365cc615d8d4cebb9c5dfdb005e05d2/users/b56fa2e7388e4967a35b4257798825b0/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:19.758070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.758366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.758709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.783388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:19.783508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.783941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.784407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c5e3b-a183-4e05-b2fc-274874225802 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:19.796369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1017/1995] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:19.797753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.798105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.798423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.815379 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:19.888166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] MFA Rules not processed for user `b56fa2e7388e4967a35b4257798825b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:19.891387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.906921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 979/1996] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:19.910795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:19.913856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:19.932396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ed783-fea7-4663-b716-dba95b1bd52a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:19.960260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:19.963595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:19.964085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:19.964627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] PATH_INFO: `/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:19.966341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a12fbdf7af489d905bd4978ae5d3dd)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:19.968389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.029184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a12fbdf7af489d905bd4978ae5d3dd', 'request_id': 'req-a8dd653d-0762-4d02-817a-bba4642dd0c9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.046320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:20.048253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a12fbdf7af489d905bd4978ae5d3dd', 'request_id': 'req-a8dd653d-0762-4d02-817a-bba4642dd0c9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.058678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a12fbdf7af489d905bd4978ae5d3dd', 'request_id': 'req-a8dd653d-0762-4d02-817a-bba4642dd0c9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.073487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1018/1997] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:20.073487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.087704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] The token cache is being invalidate because project a0a12fbdf7af489d905bd4978ae5d3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:20.087704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.087704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a8dd653d-0762-4d02-817a-bba4642dd0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.088859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b871e-4c01-4247-ae1a-07aa02c7c94d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.091718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 980/1998] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:19 2022] DELETE /identity/v3/projects/a0a12fbdf7af489d905bd4978ae5d3dd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:20.097847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.098146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.098433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.136120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:20.138374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.177455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.178234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.178781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.179400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.180306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:20.180623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.182356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.197929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1019/1999] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:20.198966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.203878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.269903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 981/2000] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:20.270641 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.272540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.285034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f127953-31fa-4cb5-a48a-2d4a1263cc99 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.286698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3514-15f1-4322-b90a-9b4287db96d4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.290145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.290885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.291021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.291356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.291716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.291820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.292195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.292551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.292656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.294488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.294599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a30eea-5a31-4f44-9317-4a0ac11ab3eb admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.327376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 982/2001] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:20.327376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.327376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.327376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.348838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:20.350284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.375379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.378697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.399011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1020/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:20.400051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.422782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:20.426427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053e57-b570-434d-8ee4-577b75223d55 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.471569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 983/2003] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:20.472603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.474073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.488715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05b55-f4dd-42c6-a89a-ce3e7d4bbb56 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.494320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.495361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.495759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.496421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] PATH_INFO: `/v3/users/b56fa2e7388e4967a35b4257798825b0` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.497757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56fa2e7388e4967a35b4257798825b0)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.499862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.503057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:20.523659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.524502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.524854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.525206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.527742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.530595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.556597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56fa2e7388e4967a35b4257798825b0'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.556844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1021/2004] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:20.557443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56fa2e7388e4967a35b4257798825b0'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.557828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.559583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.566228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56fa2e7388e4967a35b4257798825b0'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.573228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b63dd-3afe-4f21-834c-6215baa1bdfe admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.575071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56fa2e7388e4967a35b4257798825b0'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.578334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.579272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.579558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.579871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] PATH_INFO: `/v3/users/f92d35a91178444ebb1190dbdc42c9d1` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.581106 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92d35a91178444ebb1190dbdc42c9d1)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.583376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.589644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56fa2e7388e4967a35b4257798825b0'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.596452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 984/2005] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:20 2022] DELETE /identity/v3/users/b56fa2e7388e4967a35b4257798825b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:20.600232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.602541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.636223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92d35a91178444ebb1190dbdc42c9d1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.643802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92d35a91178444ebb1190dbdc42c9d1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.659344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92d35a91178444ebb1190dbdc42c9d1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.660107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92d35a91178444ebb1190dbdc42c9d1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.667402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92d35a91178444ebb1190dbdc42c9d1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:20.673812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1022/2006] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:20 2022] DELETE /identity/v3/users/f92d35a91178444ebb1190dbdc42c9d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:20.674416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.675850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.682455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c954b-ffa0-4c30-83c8-25325c95d79b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.734586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:20.751326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.752180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.752525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.752766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bdf5-c9e6-4eb6-b05f-3c51988c7c92 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.752924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.758949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:20.758949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.758949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f20b-9c6d-4be0-8793-7d7d6d81b56b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.778865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.779701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.779995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.780279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.784099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 985/2007] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:20.784099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.784099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.784099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.784543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.785615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f27dc5-54b4-4064-bb3b-5c239415574b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.803898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:20.805231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.805682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1023/2008] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:20.807081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.807583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.807794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.819295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 986/2009] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:20.821068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.824724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.833536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:20.835050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.840140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8685fa-f592-4689-813b-5c747661bc83 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.844992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1024/2010] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:20.848262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.848262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.848581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.849130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.849130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.849130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.850754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.869424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da48fbc-9e9b-4541-8d9a-bb89344dd6e7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.874088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.874946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.875433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.875851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:20.876957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:20.879109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:20.886877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 987/2011] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:20 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:20.887770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.889333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.895593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1025/2012] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:20.895593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:20.897238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:20.944875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:20.970960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824434-194a-4fa6-a414-6dbae83373fa admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:20.975043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:20.975802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:20.976183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:20.976415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.020533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1839b-9c44-4440-a10f-413ffabf0dcb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.026296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.027724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.028020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.028305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.045885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.047362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.057858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 988/2013] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:21.058488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.070186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68ea4e-d6e8-421f-8a2c-922bc8047107 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.075537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.076376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.076668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.078780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.078780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.079705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.133284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 989/2014] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:21 2022] POST /identity/v3/users => generated 290 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:21.133284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.143490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd601629-55f7-4c3a-8135-96f1994dcf06 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.149322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.150262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.150543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.150820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] PATH_INFO: `/v3/projects/b8d8cec3dc2b44518be41f86e8cecaac/users/417d65d73430478ebaee12f3e648f82b/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.156151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.158528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.171984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1026/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:21.172847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.179398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d8cec3dc2b44518be41f86e8cecaac, user_id=417d65d73430478ebaee12f3e648f82b, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.183163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754ba47-e713-4260-9b8d-a7962450ff51 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.184805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30262c-1eef-45ef-b995-50c4b100c287 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.191941 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.194152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.194447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.194894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.195895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.198059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.207844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 990/2016] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:21 2022] PUT /identity/v3/projects/b8d8cec3dc2b44518be41f86e8cecaac/users/417d65d73430478ebaee12f3e648f82b/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:21.210338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1027/2017] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:21.214619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.214865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.215078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.218826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.234597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4649e4-c166-45f8-87e3-9c15a2057289 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.265939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:21.267090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:21.364315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.365599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.366010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.366806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.371210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.375381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:21.375714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.416723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1028/2018] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:21.429534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.495992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 991/2019] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:21.496553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0ae0e-e31d-4a05-a852-53c6b48435bd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.498621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.499701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.500142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.500418 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] PATH_INFO: `/v3/projects/e6883ba9b7ad48dfbe78bd06eafe1d65/users/6699d8723e8a411da115e66aa1f0dc9e/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.510940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.527789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6883ba9b7ad48dfbe78bd06eafe1d65, user_id=6699d8723e8a411da115e66aa1f0dc9e, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.530903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacf896-5392-4408-ac70-ed49fdcc2434 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.551736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1029/2020] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:21 2022] PUT /identity/v3/projects/e6883ba9b7ad48dfbe78bd06eafe1d65/users/6699d8723e8a411da115e66aa1f0dc9e/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:21.563753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.565331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.565636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.601326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e248c-8a36-422c-aee3-68607912e499 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.613673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] MFA Rules not processed for user `6699d8723e8a411da115e66aa1f0dc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:21.615277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:21.661326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:21.681764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.682491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.682778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.683060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.761318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.762899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.773087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1030/2021] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:21.775158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 992/2022] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:21.775385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.792140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e51e0-39d3-4acd-ab92-b638c61333ac None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.797631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.798310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.798599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.798882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.799650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.801736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:21.857540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1031/2023] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:21 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:21.861592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.873858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53f837-0048-4ee1-8fc7-7eccbd775a63 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:21.908101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:21.926180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:21.929185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:21.966996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:21.967905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:21.968241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:21.968525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:21.969246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:21.971839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.010907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 993/2024] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:21 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:22.014250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.017302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.018867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b9c8-3a09-4ade-93f3-b10eb0e9db24 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.027113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.028144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.028452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.028641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] PATH_INFO: `/v3/projects/1365cc615d8d4cebb9c5dfdb005e05d2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.030058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1365cc615d8d4cebb9c5dfdb005e05d2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.033000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.043692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7617cf-aca6-4d32-92c5-d551acd97f06 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.051711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.053645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.053974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.054223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] PATH_INFO: `/v3/projects/96ef75a2f54b42ba934b3ec654f72f44` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.055720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ef75a2f54b42ba934b3ec654f72f44)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.057662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.098541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1365cc615d8d4cebb9c5dfdb005e05d2', 'request_id': 'req-3a4cadfe-165a-4e59-a8a7-2b876b68f250'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.110149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1365cc615d8d4cebb9c5dfdb005e05d2', 'request_id': 'req-3a4cadfe-165a-4e59-a8a7-2b876b68f250'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.117639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1365cc615d8d4cebb9c5dfdb005e05d2', 'request_id': 'req-3a4cadfe-165a-4e59-a8a7-2b876b68f250'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.141523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ef75a2f54b42ba934b3ec654f72f44', 'request_id': 'req-3f434425-c648-4e93-b4dd-ede8458c9628'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.141947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] The token cache is being invalidate because project 1365cc615d8d4cebb9c5dfdb005e05d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:22.142297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.143116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.148669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1032/2025] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:21 2022] DELETE /identity/v3/projects/1365cc615d8d4cebb9c5dfdb005e05d2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:22.148669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.150733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.151854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ef75a2f54b42ba934b3ec654f72f44', 'request_id': 'req-3f434425-c648-4e93-b4dd-ede8458c9628'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.166532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ef75a2f54b42ba934b3ec654f72f44', 'request_id': 'req-3f434425-c648-4e93-b4dd-ede8458c9628'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.178823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] The token cache is being invalidate because project 96ef75a2f54b42ba934b3ec654f72f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:22.179123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.179833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3f434425-c648-4e93-b4dd-ede8458c9628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.184448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 994/2026] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:22 2022] DELETE /identity/v3/projects/96ef75a2f54b42ba934b3ec654f72f44 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:22.184448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.184448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.184448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.189342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:22.209448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:22.213826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.247617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cadfe-165a-4e59-a8a7-2b876b68f250 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.294264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 995/2027] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:22.295176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.302531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.317059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9148a-80f0-40a9-9d21-d101f74a9d37 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.324230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.325532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.326104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.326524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] PATH_INFO: `/v3/users/d9219b99733d44da9d30c30a278fb37f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.328225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9219b99733d44da9d30c30a278fb37f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.330715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.344113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.344991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.345375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.345753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.346653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.348656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e602-c909-46de-b2e3-f2dffd142498 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.366959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1033/2028] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:22.368631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.369169 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.369503 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.387340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:22.391614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:22.392837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.399116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9219b99733d44da9d30c30a278fb37f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.400119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9219b99733d44da9d30c30a278fb37f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.402071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1034/2029] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:22.403011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.406010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.409568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9219b99733d44da9d30c30a278fb37f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.418765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a75f2-2e93-48cb-af30-c001ed3afff0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.423578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.424025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9219b99733d44da9d30c30a278fb37f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.424642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.424921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.425194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] PATH_INFO: `/v3/projects/7a67d199bbe84dc0aadddc0763faeab1/users/4a308fa43d194cb9aab2e0aa9f23da46/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.444588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a67d199bbe84dc0aadddc0763faeab1, user_id=4a308fa43d194cb9aab2e0aa9f23da46, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.446505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9219b99733d44da9d30c30a278fb37f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:22.447325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.455920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 996/2030] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:22 2022] DELETE /identity/v3/users/d9219b99733d44da9d30c30a278fb37f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:22.457018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.458974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.467186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1035/2031] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:22 2022] PUT /identity/v3/projects/7a67d199bbe84dc0aadddc0763faeab1/users/4a308fa43d194cb9aab2e0aa9f23da46/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:22.472453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.476825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.555505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03256e37-fa93-4749-bd5e-9817b975b861 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.626468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.626869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.627198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.627489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.628356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:22.628672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.631247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.638081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370187d-4020-4feb-8bd8-39fb3543f9f0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.644698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.645292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 997/2032] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:22.645413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.645653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.645933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.647820 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.649468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.650802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.661630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1036/2033] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:22.666971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.671159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981083ed-e38e-4f46-ad2b-f3c224c77074 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.679919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f99c-ad64-43fd-b3eb-dcc08e5244b7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.681818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.682783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.683297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.684222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.685383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.686330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.687406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.687706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.687967 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] PATH_INFO: `/v3/projects/7a67d199bbe84dc0aadddc0763faeab1/users/4a308fa43d194cb9aab2e0aa9f23da46/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.688501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.689977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a67d199bbe84dc0aadddc0763faeab1, user_id=4a308fa43d194cb9aab2e0aa9f23da46, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.694119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1fc8-be19-4071-a33d-74e003fb46f6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.706183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1037/2034] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:22 2022] PUT /identity/v3/projects/7a67d199bbe84dc0aadddc0763faeab1/users/4a308fa43d194cb9aab2e0aa9f23da46/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:22.719678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.719678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.719678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.758719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 998/2035] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:22.764673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.769124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] MFA Rules not processed for user `4a308fa43d194cb9aab2e0aa9f23da46`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:22.770602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.786009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:22.844021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:22.908746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1038/2036] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:22.911688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e203b-e66c-43cf-9ef9-214bc49f0e50 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:22.915259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.917432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:22.918196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:22.918974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:22.919356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:22.919672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:22.920365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:22.927655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:22.959917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 999/2037] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:22 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:22.965645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:22.990340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408441c9-7538-418e-b1f5-02eddbe3b146 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.000629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf5fa-9b30-4cc5-a17e-ce24fd555113 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.010339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.011079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.011501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.011785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.012530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.014297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.015699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.016523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.016815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.018276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.032347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1000/2038] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:23.034797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.049249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.051961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.063703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf4cd1-6fec-40df-9782-9d8503c94702 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.069977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.071543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.071940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.072322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.073168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.075835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.091776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1039/2039] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:23.098785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1001/2040] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:23.100488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.116743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8538d-07d5-4202-bb30-6bf2f22f359a service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.125409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.125409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.125409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.127321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.132118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] PATH_INFO: `/v3/projects/5bb2bef6e3d3434d9c70d88306749a02/users/812f6eb44b7744da935716688523160c/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.132840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.169765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889725-c414-4170-ab6f-64230d9bef2a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.175400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb2bef6e3d3434d9c70d88306749a02, user_id=812f6eb44b7744da935716688523160c, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.178912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37d221-e3e4-45f6-8d46-9480e07dd2c8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.193858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.196175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.204994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.207684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] PATH_INFO: `/v3/projects/0243daa72d6f4da9b49930ee682f3d04` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.212767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0243daa72d6f4da9b49930ee682f3d04)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.214826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.224791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1040/2041] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:23 2022] PUT /identity/v3/projects/5bb2bef6e3d3434d9c70d88306749a02/users/812f6eb44b7744da935716688523160c/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:23.225913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.226200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.226525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.272650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] MFA Rules not processed for user `417d65d73430478ebaee12f3e648f82b`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:23.273934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.277315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0243daa72d6f4da9b49930ee682f3d04', 'request_id': 'req-701f5fb3-22ba-4c2b-9714-817b39895e09'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:23.283972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0243daa72d6f4da9b49930ee682f3d04', 'request_id': 'req-701f5fb3-22ba-4c2b-9714-817b39895e09'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:23.297034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0243daa72d6f4da9b49930ee682f3d04', 'request_id': 'req-701f5fb3-22ba-4c2b-9714-817b39895e09'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:23.309904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] The token cache is being invalidate because project 0243daa72d6f4da9b49930ee682f3d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:23.310352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:23.310884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-701f5fb3-22ba-4c2b-9714-817b39895e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:23.312606 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1002/2042] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:23 2022] DELETE /identity/v3/projects/0243daa72d6f4da9b49930ee682f3d04 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:23.315913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cef44-a637-4bf0-aaad-1ab9a3b1756a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.315913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cef44-a637-4bf0-aaad-1ab9a3b1756a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.315913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cef44-a637-4bf0-aaad-1ab9a3b1756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.342444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d79cef44-a637-4bf0-aaad-1ab9a3b1756a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:23.344029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d79cef44-a637-4bf0-aaad-1ab9a3b1756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.370222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1041/2043] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:23.371254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.372665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.398065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:23.428876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1003/2044] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:23.428876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.428876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.429734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.453662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a558a-16f8-43f5-b345-177ee3dd5f92 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.458296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.459292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.459824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.460082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.460393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:23.461535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.461964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.472614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1004/2045] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:23.473309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.474733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.494694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f428035-f531-4a2e-8af6-edfde5bd47e2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.501849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.502531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.502821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.503101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.503845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.506856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.526791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:23.545608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1005/2046] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:23.546460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.549161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.573192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.575224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8c6c7-bf18-40ef-ac97-3ba949546466 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.588172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1042/2047] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:23.589645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.589945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.590230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.611913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:23.613330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:23.716574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1043/2048] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:23.718157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.726025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edd0d-dae1-4538-9e13-97ae37d16e38 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.734861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57588d-5567-4cad-97f5-7e0ac581bce0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.738229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.738916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.739232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.741730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.757973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.760442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.760764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.761021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.761733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.763985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.774353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.791003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.814782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1006/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:23.830400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.845504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1044/2050] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:23.850912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.865003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9545-502e-4f5b-ba76-b7184d642b4e service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.865787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64788acc-8369-4819-a91a-c1cb1601d4e7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.872990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.874099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.874357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.874794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.876117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.877681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.883692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.884385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.884671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.884950 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.887895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:23.888223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.895081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.895244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1045/2051] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:23.897239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.909283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91529de-072a-4973-94c6-1557c8f16ff5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.910649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1007/2052] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:23.915374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.918088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.919089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.919511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.919659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] PATH_INFO: `/v3/projects/ee51de93c02b433cb3055abb990d565f/users/d0011f2463304b17957236619f08dd80/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.938321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bd9e8-dd8b-4d4b-97bb-c494193df875 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:23.939511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee51de93c02b433cb3055abb990d565f, user_id=d0011f2463304b17957236619f08dd80, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.942670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.954407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:23.955052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:23.955374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:23.955659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:23.956365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:23.958522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:23.965542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1046/2053] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:23 2022] PUT /identity/v3/projects/ee51de93c02b433cb3055abb990d565f/users/d0011f2463304b17957236619f08dd80/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:23.966047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:23.993012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:24.000699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1008/2054] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:23 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:24.002966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.075637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa336-5307-4808-835d-545c9b009051 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.128824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adebf2-dc65-4138-81db-627f04ff8c57 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.137007 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.137903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.138571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.139041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.140024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.143238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.188203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1009/2055] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:24 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:24.189124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.200362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba2a8f-14c5-487d-87bf-9b3fbb2ce70c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.206405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.207273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.207594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.207836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.208711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.210888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.216105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.217407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.217938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.218414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.219526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.222861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.226768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1010/2056] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:24.228455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.246079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd06f0-9263-4dc6-a72a-64e4afa2adda admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.252653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1047/2057] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:24.257673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.262057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.262816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.263121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.263473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.264232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.266295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.287798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340afec-e2ff-403b-adc5-88c7160ef366 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.294153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.295416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.295801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.296545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] PATH_INFO: `/v3/projects/ee51de93c02b433cb3055abb990d565f/users/d0011f2463304b17957236619f08dd80/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.301101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee51de93c02b433cb3055abb990d565f, user_id=d0011f2463304b17957236619f08dd80, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.301922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1011/2058] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:24.304151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.305215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfd5a-8c84-4b22-8cd5-6f868b28fec7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.329034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9287e4-cb65-4835-af31-e79a48b4bffb admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.336707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1048/2059] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:24 2022] PUT /identity/v3/projects/ee51de93c02b433cb3055abb990d565f/users/d0011f2463304b17957236619f08dd80/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:24.394720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:24.444558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.445533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.445795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.446082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] PATH_INFO: `/v3/projects/f9afaaa18abe4fe197d928457512463c/users/0020470932b24946ac9d455b1909c1ba/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.462188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9afaaa18abe4fe197d928457512463c, user_id=0020470932b24946ac9d455b1909c1ba, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.464850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.491192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1012/2060] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:24 2022] PUT /identity/v3/projects/f9afaaa18abe4fe197d928457512463c/users/0020470932b24946ac9d455b1909c1ba/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:24.493067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.493364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.493647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.528476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] MFA Rules not processed for user `0020470932b24946ac9d455b1909c1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:24.529775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:24.607404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1049/2061] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:24.608595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.707171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a759e75-aa78-4d8b-b6c9-28a742954850 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.714762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.716131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.716552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.716912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.717711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.719686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.749106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1013/2062] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:24 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:24.752872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.766262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e3e7-10db-4db4-bb47-5fac54e81c7a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.822153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:24.856382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.857087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.857424 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.857764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.858767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.861876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.894753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1050/2063] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:24 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:24.897174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.908831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdb5a-bca7-4e1a-9096-77335a3a2bf1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.922683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.923639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:24.923987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:24.924339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:24.925948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:24.945366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:24.966028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1014/2064] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:24.969725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:24.988825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964048b-931b-4488-a704-84f1f6edda90 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:24.998563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:24.999893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.000226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.000527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] PATH_INFO: `/v3/projects/ef9787b70a9e4e87a069241ab4a679d8/users/347c3203ab7c44b5b13967d837d515e4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.022712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9787b70a9e4e87a069241ab4a679d8, user_id=347c3203ab7c44b5b13967d837d515e4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:25.027170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142662a-96e3-4ead-9f78-8cd32c9c2393 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:25.048108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1051/2065] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:24 2022] PUT /identity/v3/projects/ef9787b70a9e4e87a069241ab4a679d8/users/347c3203ab7c44b5b13967d837d515e4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:25.052188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:25.066968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97a55-068d-431e-9d0f-86066e0bacaa admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:25.119889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.121023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.121502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.190014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:25.190699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.190988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.191300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.192041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:25.193757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:25.211057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1015/2066] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:25.211269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] MFA Rules not processed for user `812f6eb44b7744da935716688523160c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:25.211269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:25.212790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:25.225667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd872-2f5e-46e3-8d9d-1f80ad51b1de admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:25.233333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:25.234380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.234785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.235180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] PATH_INFO: `/v3/projects/ef9787b70a9e4e87a069241ab4a679d8/users/347c3203ab7c44b5b13967d837d515e4/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.237510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9787b70a9e4e87a069241ab4a679d8, user_id=347c3203ab7c44b5b13967d837d515e4, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:25.240694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb53d0-eb5c-40e3-90d5-f6109ef3d584 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:25.258083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1016/2067] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:25 2022] PUT /identity/v3/projects/ef9787b70a9e4e87a069241ab4a679d8/users/347c3203ab7c44b5b13967d837d515e4/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:25.267757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.268183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.268566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.298653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:25.308401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] MFA Rules not processed for user `347c3203ab7c44b5b13967d837d515e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:25.309817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:25.368407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1052/2068] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:25.383977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:25.386769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:25.477101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1017/2069] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:25.504043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:25.546869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf72fd-6210-4ef3-86c8-490b6ec6dd72 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:25.623717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda32c1-3ebe-4770-b57c-2da270fb653a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:25.624786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:25.625625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.625919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.627468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.627800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:25.628464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:25.628754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:25.629035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:25.632558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:25.706256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:25.708511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109b7d8-0534-4889-b90d-ba4817953005 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:25.719084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1053/2070] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:25.749741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:25.753706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c1e1c-2cfc-46a3-a89f-6521f6ba5d0a service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:25.804475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1018/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:26.595425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:26.596327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:26.596818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:26.679056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] MFA Rules not processed for user `d0011f2463304b17957236619f08dd80`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:26.680403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:26.892832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1054/2072] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:26.896489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657f83-3bf0-4e05-9249-c81ef798bdc2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:26.898777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657f83-3bf0-4e05-9249-c81ef798bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:26.899806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657f83-3bf0-4e05-9249-c81ef798bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:26.938711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-16657f83-3bf0-4e05-9249-c81ef798bdc2 None None] MFA Rules not processed for user `417d65d73430478ebaee12f3e648f82b`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:26.940525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-16657f83-3bf0-4e05-9249-c81ef798bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:27.026760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:27.052347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1019/2073] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:27.065634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:27.068747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:27.191241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b793-f41c-4881-837d-2891a7a24e40 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:27.197873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:27.198855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:27.198966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:27.199307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:27.210309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:27.212653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:27.223723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1055/2074] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:27.309729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:27.310020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:27.310295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:27.343302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] MFA Rules not processed for user `812f6eb44b7744da935716688523160c`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:27.344501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:27.357124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1020/2075] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:31.055934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:31.057923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:31.101597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:31.202341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f390e-9a38-46e1-a835-44da5080f2db service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:31.207425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:31.208321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:31.208637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:31.208918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] PATH_INFO: `/v3/users/6699d8723e8a411da115e66aa1f0dc9e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:31.210298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6699d8723e8a411da115e66aa1f0dc9e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:31.212270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:31.266039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:31.292128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44804f75-65d6-4a53-97bf-41fd330f7984 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:31.301933 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:31.304117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:31.305088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:31.305393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:31.320236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6699d8723e8a411da115e66aa1f0dc9e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:31.321443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:31.323174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372644-8d6f-4413-a80c-08b1e8bb1f26 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:31.335505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1021/2076] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:31.340060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6699d8723e8a411da115e66aa1f0dc9e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:31.364395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6699d8723e8a411da115e66aa1f0dc9e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:31.365709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6699d8723e8a411da115e66aa1f0dc9e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:31.374606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6699d8723e8a411da115e66aa1f0dc9e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:31.385438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1056/2077] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:31 2022] DELETE /identity/v3/users/6699d8723e8a411da115e66aa1f0dc9e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:31.387194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:31.387563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:31.387916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:31.425174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:31.426753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:31.500578 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1022/2078] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:31.547655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:31.550265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:31.658668 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db45cc-8881-48cd-8b52-49ad2411c14d admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:31.664866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:31.665643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:31.666980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:31.667300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:31.684781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:31.686867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:31.709112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1057/2079] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:32.382700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:32.384996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:32.404182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b814b-8f55-467a-b533-04ebee85e660 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:32.411616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:32.412949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:32.413485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:32.414071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] PATH_INFO: `/v3/projects/e6883ba9b7ad48dfbe78bd06eafe1d65` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:32.415773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6883ba9b7ad48dfbe78bd06eafe1d65)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:32.418005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:32.503845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6883ba9b7ad48dfbe78bd06eafe1d65', 'request_id': 'req-da4ea90d-2502-416b-ab64-05d9d450841b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.527822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6883ba9b7ad48dfbe78bd06eafe1d65', 'request_id': 'req-da4ea90d-2502-416b-ab64-05d9d450841b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.539431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6883ba9b7ad48dfbe78bd06eafe1d65', 'request_id': 'req-da4ea90d-2502-416b-ab64-05d9d450841b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.564776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] The token cache is being invalidate because project e6883ba9b7ad48dfbe78bd06eafe1d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:32.565078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.566709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.569762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1023/2080] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:32 2022] DELETE /identity/v3/projects/e6883ba9b7ad48dfbe78bd06eafe1d65 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:32.573899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:32.592732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05491b01-4138-4d67-bde9-218540e92407 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:32.673335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:32.705621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:32.706694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:32.707041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:32.707439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] PATH_INFO: `/v3/users/4a308fa43d194cb9aab2e0aa9f23da46` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:32.709330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a308fa43d194cb9aab2e0aa9f23da46)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:32.711629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:32.793666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a308fa43d194cb9aab2e0aa9f23da46'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.803978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a308fa43d194cb9aab2e0aa9f23da46'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.830197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a308fa43d194cb9aab2e0aa9f23da46'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.831290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a308fa43d194cb9aab2e0aa9f23da46'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.840830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-267af12e-da2f-48cd-b34a-57f807d3b845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a308fa43d194cb9aab2e0aa9f23da46'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:32.848126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1058/2081] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:32 2022] DELETE /identity/v3/users/4a308fa43d194cb9aab2e0aa9f23da46 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:33.469519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:33.471686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:33.487472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea90d-2502-416b-ab64-05d9d450841b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:33.581232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:33.582378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:33.582818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:33.583293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] PATH_INFO: `/v3/projects/7a67d199bbe84dc0aadddc0763faeab1` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:33.584849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a67d199bbe84dc0aadddc0763faeab1)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:33.587105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:33.589429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:33.641073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a67d199bbe84dc0aadddc0763faeab1', 'request_id': 'req-bc33459d-d684-472f-92b7-cf34c3e4cec7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:33.660444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a67d199bbe84dc0aadddc0763faeab1', 'request_id': 'req-bc33459d-d684-472f-92b7-cf34c3e4cec7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:33.674700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a67d199bbe84dc0aadddc0763faeab1', 'request_id': 'req-bc33459d-d684-472f-92b7-cf34c3e4cec7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:33.706445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] The token cache is being invalidate because project 7a67d199bbe84dc0aadddc0763faeab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:33.706739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:33.713945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bc33459d-d684-472f-92b7-cf34c3e4cec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:33.715666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1024/2082] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:33 2022] DELETE /identity/v3/projects/7a67d199bbe84dc0aadddc0763faeab1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:33.720743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:33.721210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:33.721297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:33.742774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:33.744019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:33.817812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1059/2083] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:33.825568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:33.826097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:33.826531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:33.856721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:33.858019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:33.867543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1025/2084] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:33.871905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:33.881805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e15514-b6be-4940-a0f0-d87e02597b02 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:33.887124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:33.888004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:33.888108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:33.888474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:33.889079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:33.889394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:33.891002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:33.903011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1060/2085] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:33.907358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:33.917872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681602f8-d1bc-4df8-9e23-f12b2a3e7063 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:33.922640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:33.923393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:33.923743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:33.924099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:33.924973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:33.926943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:33.953605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1026/2086] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:33 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:33.957519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:33.968640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f60801-c438-46a9-a3a4-73735ce45aa8 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.013980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:34.036021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.037593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.038056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.038340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.039053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.041039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.061977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1061/2087] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:33 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:34.066413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.077266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3791d-d119-4e12-bcf5-137ebb347132 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.082844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.084040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.084415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.084591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.086374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.087681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.116885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1027/2088] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:34.120694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.131915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc972f-baec-48c6-9601-ffe49b885c39 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.136765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.137523 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.137882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.138235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.139037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.140777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5761d83-007b-47c4-acb6-a70e05e1961d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.153122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1062/2089] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:34.157094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.168159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b63ce-474f-4115-910e-c56d76a22669 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.173348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.173923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.174281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.174632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] PATH_INFO: `/v3/projects/8bd8468d0ac44ab59f99e32f2fa301c6/users/3e1e8c551ac342ef97b2d8f8bada9d28/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.200187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd8468d0ac44ab59f99e32f2fa301c6, user_id=3e1e8c551ac342ef97b2d8f8bada9d28, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.203038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.223237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1028/2090] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:34 2022] PUT /identity/v3/projects/8bd8468d0ac44ab59f99e32f2fa301c6/users/3e1e8c551ac342ef97b2d8f8bada9d28/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:34.232904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.233367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.233737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.268126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] MFA Rules not processed for user `3e1e8c551ac342ef97b2d8f8bada9d28`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:34.269597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:34.425386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1063/2091] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:34.431000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.568767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb39-df51-41b2-ac9d-51d4c55e49a5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.575829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.576667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.576951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.577305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.578329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.581725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.626903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1029/2092] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:34 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:34.628846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.645524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b456e-26e6-4be0-b5d1-36afc2f94607 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.752347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.754018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.754489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.754948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.756895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.759355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.785652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1064/2093] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:34 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:34.791412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.807264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922623-06a7-499a-bfd3-6f35440017b5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.817090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.818523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.818935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.821160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.822666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.824681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.831395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:34.839429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1030/2094] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:34.843281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.858133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eee338-3390-46ba-adf8-4f42a99bb7f5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:34.865546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:34.866818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:34.868385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:34.869223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] PATH_INFO: `/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f/users/616cb9673f4c46a0a79215afaba42d48/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:34.895969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abda79fca2ef4b7cb2f59a307c1e9b2f, user_id=616cb9673f4c46a0a79215afaba42d48, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:34.902058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:34.950649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1065/2095] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:34 2022] PUT /identity/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f/users/616cb9673f4c46a0a79215afaba42d48/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:34.954608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:34.972030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94d75-4047-4438-ae5f-72402ae2c19a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:35.138887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:35.139693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:35.139983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:35.140309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:35.141112 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:35.142860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46775d6d-69a7-40a8-bc7e-6e92e47ce406 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:35.172866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1031/2096] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:35.174406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:35.198308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af029b-3c18-4c24-a57e-e7724e89a70b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:35.203724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:35.204905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:35.205204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:35.205481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] PATH_INFO: `/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f/users/616cb9673f4c46a0a79215afaba42d48/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:35.208294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abda79fca2ef4b7cb2f59a307c1e9b2f, user_id=616cb9673f4c46a0a79215afaba42d48, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:35.211391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:35.247183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1066/2097] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:35 2022] PUT /identity/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f/users/616cb9673f4c46a0a79215afaba42d48/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:35.261098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:35.261366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:35.261643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:35.311079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] MFA Rules not processed for user `616cb9673f4c46a0a79215afaba42d48`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:35.312424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:35.406999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1032/2098] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:35.418863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:35.420610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:35.427160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:35.485950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fbeaf-b710-4f20-a23d-03c7603ab629 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:35.489729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:35.490511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:35.490803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:35.491076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:35.501006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:35.502453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:35.512969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1067/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:35.605617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:35.617405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a49fe-352c-498f-9e16-363b2e246b03 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:35.630083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:35.630083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:35.630083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:35.630083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:35.704270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:35.706826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb338b-eb60-403b-96c3-30032bcd1b2b service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:35.719319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1033/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:36.670222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:36.672302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:36.783885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2915-1933-49cf-bc88-9c007d39b932 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:36.790027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:36.791413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:36.791841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:36.793194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] PATH_INFO: `/v3/users/0020470932b24946ac9d455b1909c1ba` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:36.795002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0020470932b24946ac9d455b1909c1ba)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:36.798008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:36.864318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0020470932b24946ac9d455b1909c1ba'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:36.874071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0020470932b24946ac9d455b1909c1ba'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:36.887845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0020470932b24946ac9d455b1909c1ba'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:36.888541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0020470932b24946ac9d455b1909c1ba'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:36.895438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0020470932b24946ac9d455b1909c1ba'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:36.904802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1068/2101] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:36 2022] DELETE /identity/v3/users/0020470932b24946ac9d455b1909c1ba => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:36.906687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:36.907180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:36.907281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:36.925851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:36.927721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:36.950617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:37.022603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1034/2102] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:37.032729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:37.034184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:37.070809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:37.108699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325d6a-3123-485b-ad4c-368833b96e65 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:37.113839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:37.114754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:37.115217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:37.115639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:37.126915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:37.131722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:37.146944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1069/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:37.687163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:37.689410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:37.713482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12e6d5-6158-4674-9130-6be64af40396 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:37.718209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:37.719317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:37.720337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:37.721008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] PATH_INFO: `/v3/projects/f9afaaa18abe4fe197d928457512463c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:37.723187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9afaaa18abe4fe197d928457512463c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:37.729101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:37.827408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9afaaa18abe4fe197d928457512463c', 'request_id': 'req-90adbe66-4e13-456e-ac7f-07f5f53f638d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:37.844449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9afaaa18abe4fe197d928457512463c', 'request_id': 'req-90adbe66-4e13-456e-ac7f-07f5f53f638d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:37.859762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9afaaa18abe4fe197d928457512463c', 'request_id': 'req-90adbe66-4e13-456e-ac7f-07f5f53f638d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:37.884473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] The token cache is being invalidate because project f9afaaa18abe4fe197d928457512463c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:37.884775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:37.885798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-90adbe66-4e13-456e-ac7f-07f5f53f638d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:37.888424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1035/2104] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:37 2022] DELETE /identity/v3/projects/f9afaaa18abe4fe197d928457512463c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:37.891875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:37.906450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65b3f-aef5-47fd-b2d6-452629c3b46d service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:38.013275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:38.015882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.016739 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.017303 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] PATH_INFO: `/v3/users/347c3203ab7c44b5b13967d837d515e4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.022960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=347c3203ab7c44b5b13967d837d515e4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:38.025414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:38.087115 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347c3203ab7c44b5b13967d837d515e4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.097642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347c3203ab7c44b5b13967d837d515e4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.114080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347c3203ab7c44b5b13967d837d515e4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.114266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347c3203ab7c44b5b13967d837d515e4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.125499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347c3203ab7c44b5b13967d837d515e4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.138556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1070/2105] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:37 2022] DELETE /identity/v3/users/347c3203ab7c44b5b13967d837d515e4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:38.441693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf98d1-4a77-4497-a37c-ed9781df5a60 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.442587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf98d1-4a77-4497-a37c-ed9781df5a60 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.443979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:38.444252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf98d1-4a77-4497-a37c-ed9781df5a60 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.445560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.447639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1036/2106] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:46:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:46:38.486264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.486868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.487365 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.526081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:38.533304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:38.539800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.558025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889c8e-68fa-49de-8def-bbdc21178153 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:38.571641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:38.573167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.573565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.573790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] PATH_INFO: `/v3/projects/ef9787b70a9e4e87a069241ab4a679d8` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.575734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9787b70a9e4e87a069241ab4a679d8)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:38.579937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:38.659700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9787b70a9e4e87a069241ab4a679d8', 'request_id': 'req-be2651bb-7578-4704-a600-d2eb4651d401'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.674915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9787b70a9e4e87a069241ab4a679d8', 'request_id': 'req-be2651bb-7578-4704-a600-d2eb4651d401'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.682816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1037/2107] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:46:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:38.683814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:38.685324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.690286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9787b70a9e4e87a069241ab4a679d8', 'request_id': 'req-be2651bb-7578-4704-a600-d2eb4651d401'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.704956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] The token cache is being invalidate because project ef9787b70a9e4e87a069241ab4a679d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:38.705246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.705913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.708094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1071/2108] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:38 2022] DELETE /identity/v3/projects/ef9787b70a9e4e87a069241ab4a679d8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:38.709747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:38.711929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.718139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e498cf-4a64-4a9e-afe7-506e6e737823 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:38.794629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:38.825797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:38.826708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.827042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.827392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] PATH_INFO: `/v3/users/7c8067d2568e4ec1a9f2824d55922cd6` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.828619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8067d2568e4ec1a9f2824d55922cd6)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:38.831235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:38.836157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2651bb-7578-4704-a600-d2eb4651d401 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:38.843012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:38.843863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.844222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.844576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.847508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.872490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:38.874868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacb419-83f5-41c5-9c21-6423767e6e58 service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:38.899831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1072/2109] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:38.901360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3af4-7945-45eb-b0f0-26f526eb8f52 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.901811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3af4-7945-45eb-b0f0-26f526eb8f52 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.902300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3af4-7945-45eb-b0f0-26f526eb8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.906221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8067d2568e4ec1a9f2824d55922cd6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.906986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8067d2568e4ec1a9f2824d55922cd6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.918382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8067d2568e4ec1a9f2824d55922cd6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.925251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e85e3af4-7945-45eb-b0f0-26f526eb8f52 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:38.926539 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e85e3af4-7945-45eb-b0f0-26f526eb8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:38.928923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8067d2568e4ec1a9f2824d55922cd6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.936232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1073/2110] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:38.945287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:38.946228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:38.946640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:38.949675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8067d2568e4ec1a9f2824d55922cd6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:38.970108 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1038/2111] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:38 2022] DELETE /identity/v3/users/7c8067d2568e4ec1a9f2824d55922cd6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:39.048559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:39.050213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.199423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1074/2112] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:39.201179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.217171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cef4-460d-4bbd-b99b-bd4f52bbc8b2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.231482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.232046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.232333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.232672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.233362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:39.233678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.237291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.268498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1039/2113] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:39.273307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.278653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:39.291654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ee9-1447-483d-83b9-d96c4e92c4a3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.293452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.295662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.308473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.308646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.309821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.310466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.311262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.315277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7a75-b537-4132-b326-7eb8fe673336 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.316092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.325923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.327784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.328182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.329465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] PATH_INFO: `/v3/projects/9089d053721d4eae9705edf3b0910771` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.331086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9089d053721d4eae9705edf3b0910771)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.333562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.371177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1075/2114] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:39.372921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.396941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9089d053721d4eae9705edf3b0910771', 'request_id': 'req-0086359e-f827-4ed1-a151-e9047bd7b65a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:39.406254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9089d053721d4eae9705edf3b0910771', 'request_id': 'req-0086359e-f827-4ed1-a151-e9047bd7b65a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:39.418395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9089d053721d4eae9705edf3b0910771', 'request_id': 'req-0086359e-f827-4ed1-a151-e9047bd7b65a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:39.441758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] The token cache is being invalidate because project 9089d053721d4eae9705edf3b0910771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:39.443231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:39.443811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0086359e-f827-4ed1-a151-e9047bd7b65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:39.445859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1040/2115] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:39 2022] DELETE /identity/v3/projects/9089d053721d4eae9705edf3b0910771 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:39.450720 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e44b-e463-406b-81a5-977ed9b81b75 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.451074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e44b-e463-406b-81a5-977ed9b81b75 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.451388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e44b-e463-406b-81a5-977ed9b81b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.456464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137daca0-d575-4dcb-b215-16175a84fcf0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.470902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4e85e44b-e463-406b-81a5-977ed9b81b75 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:39.472380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4e85e44b-e463-406b-81a5-977ed9b81b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.500672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:39.534161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.535065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.535442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.536076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.537631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.539971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.552731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1041/2116] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:39.554770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.555310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.555853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.575804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:39.577093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.589522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1042/2117] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:39.591433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1076/2118] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:39.593857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.596346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.600354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.607753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5cac-473b-4dbe-93cc-869ff21a49b1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.613203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.615164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.615559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.615940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.617342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:39.617759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.619924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.620509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107369-bb45-4bf2-b359-3af36f47d96b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.642801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.643535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.643895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.644765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.645177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.647286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.653287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1043/2119] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:39.655891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.666766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1077/2120] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:39.671406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.678913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34271d45-e0cd-4195-8152-af24e3adbf02 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.684246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.684410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34391cf7-d7d0-470c-8ade-d304e0ac2c14 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.684990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.685279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.685716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.686251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.688358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.690099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.690984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.691467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.691918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.692953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.695163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.707462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1078/2121] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:39.720852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.735188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1044/2122] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:39.736572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6872-029c-4255-a8f8-c345db201a2b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.737947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.809727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:39.812666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2464f0-964e-4d7d-a9b0-527c66ebb1ce admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.819203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.820265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.820627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.821122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.821923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.824445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.824570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.825682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.826079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.826429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] PATH_INFO: `/v3/projects/9685e16d59a345858c69e0a0384e5427/users/91892903136042deb9191491bcdc88b6/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.851876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1045/2123] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:39.852150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9685e16d59a345858c69e0a0384e5427, user_id=91892903136042deb9191491bcdc88b6, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.854212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:39.854319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc954ea9-db2d-4ff3-a84c-3728ee7fce5a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.867954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686cf9-51c3-47d7-981a-2ba196bfba99 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:39.875368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1079/2124] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:39 2022] PUT /identity/v3/projects/9685e16d59a345858c69e0a0384e5427/users/91892903136042deb9191491bcdc88b6/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:39.888411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.888411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.888726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.922441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] MFA Rules not processed for user `91892903136042deb9191491bcdc88b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:39.923973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:39.962157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:39.962843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:39.963254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:39.963541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:39.964279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:39.965894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:39.983433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1046/2125] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:39.988434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:40.001345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c29a-b650-49f0-9194-219a0626e1f4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:40.007932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:40.008977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:40.009351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:40.009706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:40.010605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:40.012146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1080/2126] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:40.012351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:40.024154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:40.025695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:40.029781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1047/2127] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:40.033880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:40.040075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:40.045657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b660806-6a68-4dba-8817-6e2dfe999bdc admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:40.052031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:40.052949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:40.053662 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:40.053931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] PATH_INFO: `/v3/projects/91a7bbc979114407a852d6982073596b/users/9a671fbfa3374b288551871a4f4198d8/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:40.070818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a7bbc979114407a852d6982073596b, user_id=9a671fbfa3374b288551871a4f4198d8, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:40.074333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b196f2-fcea-4454-b99e-e3a6e842e192 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:40.095708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1048/2128] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:40 2022] PUT /identity/v3/projects/91a7bbc979114407a852d6982073596b/users/9a671fbfa3374b288551871a4f4198d8/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:40.102930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:40.103273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:40.103522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:40.123527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:40.124746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:40.137991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f019-e600-40bd-ac66-169658a03aec None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:40.199850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1049/2129] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:40.201582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:40.202284 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:40.202569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:40.202845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:40.210861 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:40.212619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:40.251939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:40.281215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:40.283355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:40.287830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55761d-771e-40fd-805f-4b9c167853f4 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:40.292686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:40.293369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:40.294271 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:40.294579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:40.296875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1081/2130] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:40.307794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:40.309899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:40.324545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1050/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:41.956408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:41.965661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c568220-b866-41d9-974d-47cd6f8f8231 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:41.969599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:41.970156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:41.970525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:41.971104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:41.973510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:42.090275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:42.092460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f2df-41f7-4945-92aa-eeeca7a685e7 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:42.104337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1082/2132] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:42.572000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:42.573600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:42.596466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6096-42c9-444e-8b50-7d74cb7d21ea service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:42.605726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:42.607243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:42.608194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:42.609135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] PATH_INFO: `/v3/users/3e1e8c551ac342ef97b2d8f8bada9d28` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:42.612435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1e8c551ac342ef97b2d8f8bada9d28)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:42.620754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:42.707062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1e8c551ac342ef97b2d8f8bada9d28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:42.707994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1e8c551ac342ef97b2d8f8bada9d28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:42.718794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1e8c551ac342ef97b2d8f8bada9d28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:42.728172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1e8c551ac342ef97b2d8f8bada9d28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:42.740946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:42.744447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1e8c551ac342ef97b2d8f8bada9d28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:42.752443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1051/2133] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:42 2022] DELETE /identity/v3/users/3e1e8c551ac342ef97b2d8f8bada9d28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:42.758454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:42.758749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:42.759035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:42.779048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:42.780267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:42.855182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1083/2134] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:42.866206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:42.867669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:42.992635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c9602-2318-491a-97db-8eeee9f4fd24 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:42.997509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:42.998192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:42.998562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:42.998956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:43.016762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:43.018371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:43.038849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1052/2135] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:43.757867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:43.759726 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:43.781942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6cd1-9933-4189-9500-d6c584914196 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:43.797596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:43.799374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:43.799833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:43.800569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] PATH_INFO: `/v3/projects/8bd8468d0ac44ab59f99e32f2fa301c6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:43.803465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd8468d0ac44ab59f99e32f2fa301c6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:43.807778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:43.941004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd8468d0ac44ab59f99e32f2fa301c6', 'request_id': 'req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:43.954201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd8468d0ac44ab59f99e32f2fa301c6', 'request_id': 'req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:43.971874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd8468d0ac44ab59f99e32f2fa301c6', 'request_id': 'req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:43.983321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:43.996686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] The token cache is being invalidate because project 8bd8468d0ac44ab59f99e32f2fa301c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:43.997307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:43.998258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.006327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:44.011454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1084/2136] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:43 2022] DELETE /identity/v3/projects/8bd8468d0ac44ab59f99e32f2fa301c6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:44.021227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb382-0069-4600-89a0-554c984988ad service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:44.157336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:44.158397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:44.158780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:44.159060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] PATH_INFO: `/v3/users/616cb9673f4c46a0a79215afaba42d48` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:44.160330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=616cb9673f4c46a0a79215afaba42d48)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:44.179972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:44.290078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616cb9673f4c46a0a79215afaba42d48'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.291458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616cb9673f4c46a0a79215afaba42d48'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.304866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616cb9673f4c46a0a79215afaba42d48'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.317486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616cb9673f4c46a0a79215afaba42d48'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.338146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-29dfd039-68c1-43e9-8729-709c2a04e87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616cb9673f4c46a0a79215afaba42d48'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:44.340046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1053/2137] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:44 2022] DELETE /identity/v3/users/616cb9673f4c46a0a79215afaba42d48 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:44.869990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:44.871638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:44.892730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0fd5d-b29e-4b76-abaf-2a178ddcff52 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:44.978135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:44.979213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:44.979479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:44.979758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] PATH_INFO: `/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:44.981796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abda79fca2ef4b7cb2f59a307c1e9b2f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:44.983897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.065800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abda79fca2ef4b7cb2f59a307c1e9b2f', 'request_id': 'req-1e5ee587-b5c5-4530-b198-305eefa21329'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:45.084558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abda79fca2ef4b7cb2f59a307c1e9b2f', 'request_id': 'req-1e5ee587-b5c5-4530-b198-305eefa21329'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:45.094406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abda79fca2ef4b7cb2f59a307c1e9b2f', 'request_id': 'req-1e5ee587-b5c5-4530-b198-305eefa21329'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:45.109639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] The token cache is being invalidate because project abda79fca2ef4b7cb2f59a307c1e9b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:45.109845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:45.110495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1e5ee587-b5c5-4530-b198-305eefa21329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:45.112135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1085/2138] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:44 2022] DELETE /identity/v3/projects/abda79fca2ef4b7cb2f59a307c1e9b2f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:45.117855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.118844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.119180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.138395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:45.139670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:45.150165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:45.209856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1054/2139] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:45.218949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.219893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.220322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.250283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:45.252227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:45.264364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1086/2140] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:45.268236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.287714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb7b0-f392-4f8e-bce4-423e92359afa None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.305132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.306330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.306880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.307746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.309489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:45.310080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.312052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.334678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1055/2141] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:45.335707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.352195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc6540-caaf-4acb-846f-77e930509d88 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.359357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.360861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.361181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.361563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.362371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.365310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.411645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.417639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1087/2142] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:45.428247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a3ec-0766-4a05-9d9c-16457d3e3864 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.519020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.519836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.520181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.520504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.521230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.525155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.551767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1056/2143] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:45.556281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.572388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dec7e-ce32-46bc-9fa6-d6d69f1db72f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.586696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.587444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.587735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.588023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.592336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.594042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.627556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1088/2144] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:45.631300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.646571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d3fc-4da0-43f5-a0d3-bde31a431d03 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.653127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.653896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.654392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.654748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.656854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.659413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189e03a-3d49-4d2e-b6a8-3135c7f0e1e7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.674874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1057/2145] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:45.679736 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.694805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b744-d8c4-41f6-88ef-5a8390762111 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:45.702616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:45.703753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.704043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.704327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] PATH_INFO: `/v3/projects/ca39ed94e50049cf96c4d824b8d2e489/users/6a0c5b2e62ef4767808167604bf8733b/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.732867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca39ed94e50049cf96c4d824b8d2e489, user_id=6a0c5b2e62ef4767808167604bf8733b, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:45.738236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:45.762530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1089/2146] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:45 2022] PUT /identity/v3/projects/ca39ed94e50049cf96c4d824b8d2e489/users/6a0c5b2e62ef4767808167604bf8733b/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:45.774229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:45.774532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:45.774817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:45.821347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] MFA Rules not processed for user `6a0c5b2e62ef4767808167604bf8733b`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:45.823164 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:45.914301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1058/2147] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:45.919410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:45.961265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:46.014201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec29f3-b395-428e-b588-65b859fb1c8b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.021794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.022491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.022779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.023062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.023912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.025877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.067357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1090/2148] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:45 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:46.071197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.084241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ff625-32f3-435d-9ab5-f800bea99cc1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.097196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:46.203818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.204526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.204803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.205082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.205800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.207851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.243747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1059/2149] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:46 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:46.244814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.260200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1367dd-ce05-4f0e-a72e-774bd06060c6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.268170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.268839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.269128 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.269414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.270159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.272594 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.290461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1091/2150] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:46.294820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.306148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf98f9-a41c-4300-a368-ba3a12ee0505 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.312186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.313188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.313545 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.313898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] PATH_INFO: `/v3/projects/1f6b50f990684417b00d9adf21b072ea/users/101ff1422bf04dfa9d2745d04015eba3/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.335071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b50f990684417b00d9adf21b072ea, user_id=101ff1422bf04dfa9d2745d04015eba3, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.338111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7fb7d-2386-449e-9fe6-a71d2a5558e8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.369020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1060/2151] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:46 2022] PUT /identity/v3/projects/1f6b50f990684417b00d9adf21b072ea/users/101ff1422bf04dfa9d2745d04015eba3/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:46.372837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.392430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c365-f1d8-46ed-82de-ba849f807d5a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.419495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.419945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.420293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.466431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] MFA Rules not processed for user `9a671fbfa3374b288551871a4f4198d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:46.467666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:46.543448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.545118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.545493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.545782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.546531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.548673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.563801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1092/2152] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:46.579375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.595707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1061/2153] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:46.613793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4b3c-aea8-4d53-8f81-78b898c14102 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.615916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.617747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:46.626369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.627647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.628142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.628603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] PATH_INFO: `/v3/projects/1f6b50f990684417b00d9adf21b072ea/users/101ff1422bf04dfa9d2745d04015eba3/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.634495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b50f990684417b00d9adf21b072ea, user_id=101ff1422bf04dfa9d2745d04015eba3, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:46.637860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd14a-e0ef-44b8-b137-09ff817cb6ca admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:46.671164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1093/2154] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:46 2022] PUT /identity/v3/projects/1f6b50f990684417b00d9adf21b072ea/users/101ff1422bf04dfa9d2745d04015eba3/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:46.673296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.673588 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.673870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:46.718888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] MFA Rules not processed for user `101ff1422bf04dfa9d2745d04015eba3`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:46.724638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:46.753087 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:46.760301 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c597-100f-4f5a-b3fb-e78ea899aae1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:46.832928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1094/2155] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:46.835186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:46.845806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:46.854333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:46.884586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:46.885274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:46.885559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:46.885855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.043379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26657-9b5a-4c08-9cbf-cef53a7a700b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:47.050978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:47.052758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:47.053113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:47.053467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] PATH_INFO: `/v3/users/91892903136042deb9191491bcdc88b6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.054780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91892903136042deb9191491bcdc88b6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:47.057017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:47.073634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:47.075302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:47.096811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1062/2156] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:47.110999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:47.120782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.145425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91892903136042deb9191491bcdc88b6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:47.164566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91892903136042deb9191491bcdc88b6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:47.195603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91892903136042deb9191491bcdc88b6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:47.196380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91892903136042deb9191491bcdc88b6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:47.252457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a4d10179-a752-4187-a8e1-1a2abc9a92e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91892903136042deb9191491bcdc88b6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:47.309852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1095/2157] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:46 2022] DELETE /identity/v3/users/91892903136042deb9191491bcdc88b6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:47.319497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:47.319792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:47.320074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.345377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b7aaf-94f8-4a2a-8fc3-c618a14c3a56 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:47.406446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:47.407709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.512086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:47.513037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:47.513480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:47.513908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.516183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.555080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:47.576571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1096/2158] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:47.603980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:47.607501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.669103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:47.670682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:47.683954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1063/2159] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:47.698250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:47.788490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:47.789983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.805438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f720099-7953-407d-b868-88ea5a41b5b4 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:47.809750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fe230-66c1-4ddc-9e56-ec7448d47f4b service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:47.824119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:47.824956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:47.825884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:47.825884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.844703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:47.845841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:47.847551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:47.848026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:47.851607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:47.854787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:47.855545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:47.880782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1097/2160] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:47.985077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:47.988285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eab906-7819-4e59-9a4a-6c18364c5020 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:48.005595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1064/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:48.378543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:48.381846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:48.425756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a958bd-8a14-428b-8709-1705d813635c service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:48.451009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:48.462500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.465836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.467168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] PATH_INFO: `/v3/projects/9685e16d59a345858c69e0a0384e5427` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.473149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9685e16d59a345858c69e0a0384e5427)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:48.482599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:48.617512 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9685e16d59a345858c69e0a0384e5427', 'request_id': 'req-7141cf6d-cebd-4005-a90c-29932a69b118'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:48.631812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9685e16d59a345858c69e0a0384e5427', 'request_id': 'req-7141cf6d-cebd-4005-a90c-29932a69b118'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:48.641402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9685e16d59a345858c69e0a0384e5427', 'request_id': 'req-7141cf6d-cebd-4005-a90c-29932a69b118'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:48.659404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] The token cache is being invalidate because project 9685e16d59a345858c69e0a0384e5427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:48.659953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:48.660621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7141cf6d-cebd-4005-a90c-29932a69b118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:48.664033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1098/2162] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:48 2022] DELETE /identity/v3/projects/9685e16d59a345858c69e0a0384e5427 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:48.669536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.670220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.670220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.699790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:48.701514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:48.789755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1065/2163] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:48.797531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd116b-4936-4303-8a4e-f286bee6d851 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.797818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd116b-4936-4303-8a4e-f286bee6d851 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.798094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd116b-4936-4303-8a4e-f286bee6d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.830207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1ffd116b-4936-4303-8a4e-f286bee6d851 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:48.830207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1ffd116b-4936-4303-8a4e-f286bee6d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:48.842598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1099/2164] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:48.847103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:48.862314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea747d25-5013-491d-bb78-d75987345d17 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:48.870791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:48.871707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.872327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.872776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.873736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:48.875160 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:48.877398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:48.908782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.910003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1066/2165] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:48.915600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.915984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.918178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:48.932346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7285f-5926-4120-933d-72f12271af60 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:48.937983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:48.938852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:48.939154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:48.939511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:48.940298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:48.942084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:48.960445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] MFA Rules not processed for user `812f6eb44b7744da935716688523160c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:48.962142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:48.979035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1067/2166] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:48 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:48.982804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:48.999459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:49.055762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1100/2167] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:49.075988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39983f7f-74c4-4cf6-86a2-09255076e9a0 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:49.081296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:49.082112 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.082589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.083510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.084513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:49.086785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:49.124523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1068/2168] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:48 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:49.128568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:49.143720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0cdd6-838c-4515-83e9-130a5c51b436 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:49.169153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:49.170570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.170947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.171281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.172089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:49.173937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:49.188180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1101/2169] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:49.192959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:49.207774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b70c3-8e95-4edd-9039-b29201aaaf3f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:49.220204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:49.220941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.221241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.221525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.222407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:49.224941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7b8f4-9be1-4eab-b4aa-c0fb62e797df admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:49.239687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1069/2170] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:49.251292 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:49.259332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ca69-752c-4fe8-95fa-fd93c3f8ac1b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:49.269639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:49.271782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.272173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.272555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] PATH_INFO: `/v3/projects/b3d5e1ada51e4070917bc3fd97b560a5/users/6795657df37a41c7a0278a7d9af51e80/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.304232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d5e1ada51e4070917bc3fd97b560a5, user_id=6795657df37a41c7a0278a7d9af51e80, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:49.310563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:49.337526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1102/2171] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:49 2022] PUT /identity/v3/projects/b3d5e1ada51e4070917bc3fd97b560a5/users/6795657df37a41c7a0278a7d9af51e80/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:49.349178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42e3f-9c37-42d2-8cfd-d68a36759d9a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.349178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42e3f-9c37-42d2-8cfd-d68a36759d9a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.349580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42e3f-9c37-42d2-8cfd-d68a36759d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.386554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2ac42e3f-9c37-42d2-8cfd-d68a36759d9a None None] MFA Rules not processed for user `6795657df37a41c7a0278a7d9af51e80`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:49.388652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2ac42e3f-9c37-42d2-8cfd-d68a36759d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:49.499957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1070/2172] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:49.513891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:49.515699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:49.543408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:49.626675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ada985-cda4-4efa-bf54-a1365ceab4a5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:49.632420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:49.633946 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:49.634306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:49.634712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:49.653147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:49.653147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:49.687521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1103/2173] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:50.187346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:50.187851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:50.187947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:50.228526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] MFA Rules not processed for user `9a671fbfa3374b288551871a4f4198d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:50.230396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:50.414485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1071/2174] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:52.765788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:52.767546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:52.861357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67193-0aa0-438a-828f-e53aba0aac6e service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:52.866456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:52.867608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:52.868640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:52.868943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:52.869213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] PATH_INFO: `/v3/users/6a0c5b2e62ef4767808167604bf8733b` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:52.870427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0c5b2e62ef4767808167604bf8733b)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:52.872433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:52.878668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbc104-c7ff-4265-a03c-c0631551c7d5 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:52.883415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:52.884311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:52.884598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:52.884878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] PATH_INFO: `/v3/users/6795657df37a41c7a0278a7d9af51e80` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:52.886106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6795657df37a41c7a0278a7d9af51e80)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:52.888091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:52.914905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:52.927747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0c5b2e62ef4767808167604bf8733b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.936689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0c5b2e62ef4767808167604bf8733b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.945524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6795657df37a41c7a0278a7d9af51e80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.946221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6795657df37a41c7a0278a7d9af51e80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.952744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0c5b2e62ef4767808167604bf8733b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.953596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0c5b2e62ef4767808167604bf8733b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.955557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6795657df37a41c7a0278a7d9af51e80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.963921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1c2d7342-b36a-43a4-ace5-8c0faf235358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0c5b2e62ef4767808167604bf8733b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.965872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6795657df37a41c7a0278a7d9af51e80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:52.972533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1104/2175] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:52 2022] DELETE /identity/v3/users/6a0c5b2e62ef4767808167604bf8733b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:52.977981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:52.978903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:52.979223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:53.015929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-4048bd6b-e06b-4052-a83b-a35ab093495c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6795657df37a41c7a0278a7d9af51e80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:53.018834 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:53.020845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:53.033112 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1072/2176] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:52 2022] DELETE /identity/v3/users/6795657df37a41c7a0278a7d9af51e80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:53.037898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:53.038407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:53.038888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:53.070213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:53.071766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:53.087604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:53.136556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1105/2177] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:53.156325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:53.162160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:53.228622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1073/2178] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:53.273983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab8fc-aa41-4590-8101-64e0499d5564 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:53.279183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:53.279996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:53.280413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:53.280798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:53.293379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:53.294495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:53.296121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:53.312092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:53.323028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755a9be-061b-4753-8e5e-b72fe51b4d58 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:53.333086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:53.336832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:53.337242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:53.352305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:53.362655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1106/2179] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:53.391208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:53.395761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:53.422562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1074/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:54.257225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.259732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.274390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c94c2-0aac-4dcc-a42f-8e012c5187b8 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:54.279345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.279836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:54.282038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.300697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65163a-490e-404f-81d4-56a33936abe1 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:54.310955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.311312 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.311610 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] PATH_INFO: `/v3/projects/ca39ed94e50049cf96c4d824b8d2e489` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.312915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:54.314964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.315417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.316147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] PATH_INFO: `/v3/projects/b3d5e1ada51e4070917bc3fd97b560a5` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.319254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d5e1ada51e4070917bc3fd97b560a5)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:54.323158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:54.324917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca39ed94e50049cf96c4d824b8d2e489)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:54.330107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:54.413413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d5e1ada51e4070917bc3fd97b560a5', 'request_id': 'req-e98375e3-0f69-4629-b34c-6f185528e8c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.421407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d5e1ada51e4070917bc3fd97b560a5', 'request_id': 'req-e98375e3-0f69-4629-b34c-6f185528e8c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.431325 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d5e1ada51e4070917bc3fd97b560a5', 'request_id': 'req-e98375e3-0f69-4629-b34c-6f185528e8c1'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.446162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca39ed94e50049cf96c4d824b8d2e489', 'request_id': 'req-07f771e9-3a9b-44f3-ae63-5d382949c10a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.449012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] The token cache is being invalidate because project b3d5e1ada51e4070917bc3fd97b560a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:54.449654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.450425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e98375e3-0f69-4629-b34c-6f185528e8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.453562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1075/2181] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:54 2022] DELETE /identity/v3/projects/b3d5e1ada51e4070917bc3fd97b560a5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:46:54.459210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca39ed94e50049cf96c4d824b8d2e489', 'request_id': 'req-07f771e9-3a9b-44f3-ae63-5d382949c10a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.461394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8855d-a827-4e61-9102-683110d078c1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.461693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8855d-a827-4e61-9102-683110d078c1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.461980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8855d-a827-4e61-9102-683110d078c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.468113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca39ed94e50049cf96c4d824b8d2e489', 'request_id': 'req-07f771e9-3a9b-44f3-ae63-5d382949c10a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.482608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:54.492086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] The token cache is being invalidate because project ca39ed94e50049cf96c4d824b8d2e489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:54.492382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.493138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.494405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-50f8855d-a827-4e61-9102-683110d078c1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:54.494797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1107/2182] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:54 2022] DELETE /identity/v3/projects/ca39ed94e50049cf96c4d824b8d2e489 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:54.496899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-50f8855d-a827-4e61-9102-683110d078c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.500008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.501358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.603189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1076/2183] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:54.635370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f771e9-3a9b-44f3-ae63-5d382949c10a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:54.641083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:54.642320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.642320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.642614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] PATH_INFO: `/v3/users/101ff1422bf04dfa9d2745d04015eba3` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.643950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=101ff1422bf04dfa9d2745d04015eba3)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:54.646111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:54.649890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:54.671732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586a2af-4759-41cb-999c-74094772222c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.671942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586a2af-4759-41cb-999c-74094772222c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.672173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586a2af-4759-41cb-999c-74094772222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.691878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6586a2af-4759-41cb-999c-74094772222c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:54.693468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6586a2af-4759-41cb-999c-74094772222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.725484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1077/2184] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:54.731426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586a2af-4759-41cb-999c-74094772222c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.741435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101ff1422bf04dfa9d2745d04015eba3'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.749974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586a2af-4759-41cb-999c-74094772222c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:54.761212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101ff1422bf04dfa9d2745d04015eba3'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.765717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:54.765717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.765717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.765717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.766109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:54.766416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:54.768582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:54.777197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101ff1422bf04dfa9d2745d04015eba3'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.778462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101ff1422bf04dfa9d2745d04015eba3'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.786655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1078/2185] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:46:54.791027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.794597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:54.796544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101ff1422bf04dfa9d2745d04015eba3'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:54.813735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1108/2186] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:46:54 2022] DELETE /identity/v3/users/101ff1422bf04dfa9d2745d04015eba3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:54.813830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73cec-434d-4713-8c12-b6648ca5d421 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:54.921242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:54.923978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:54.924375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:54.924728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:54.926184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:54.933637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:54.979778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1079/2187] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:54 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:54.984224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:54.996344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c7154-2d31-4df3-add9-cc55333caecb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.122084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.122828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.123283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.123579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.124114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.126193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.159239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1109/2188] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:54 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:55.163381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.181517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5bcf-e071-49b7-a529-f9eba879b7da admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.197062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.197849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.198479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.198836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.199718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.201604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.215939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1080/2189] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:55.219953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.230672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f6bd-2433-4489-9384-613847b7f759 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.235664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.236338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.236622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.236903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.237641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.240012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9471ac-bcd1-42b5-9af8-cdc379ed6b48 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.250876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1110/2190] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:46:55.256256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.270883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc5bd-a214-49a9-a04a-5c38aa72acb0 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.276850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.277891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.279264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.279575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] PATH_INFO: `/v3/projects/5d7ffdf6deff4fa89a282804f01f97b7/users/d488a02933c04e79ad1caa8c3f64fc3c/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.314574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7ffdf6deff4fa89a282804f01f97b7, user_id=d488a02933c04e79ad1caa8c3f64fc3c, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.317467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.354229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1081/2191] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:55 2022] PUT /identity/v3/projects/5d7ffdf6deff4fa89a282804f01f97b7/users/d488a02933c04e79ad1caa8c3f64fc3c/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:55.356413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.356873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.356968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.394114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] MFA Rules not processed for user `d488a02933c04e79ad1caa8c3f64fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:55.395438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:55.456179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:55.467415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.469730 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:55.482466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1111/2192] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:55.494704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.496180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:55.517985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:55.546216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3473-0bdc-4476-8494-a82e32274faa admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.550993 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.553099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.553245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.553522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] PATH_INFO: `/v3/projects/1f6b50f990684417b00d9adf21b072ea` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.554716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b50f990684417b00d9adf21b072ea)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.556711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.558719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34cc08-41b1-407d-bcc5-0800bb8792d2 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.562827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.563951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.564804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.564804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.575083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.576680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0c22-ad41-4576-8888-5de65576094c service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.586708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1112/2193] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:46:55.622808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b50f990684417b00d9adf21b072ea', 'request_id': 'req-7bb156d9-cf0b-4a34-b661-a456f8593c60'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:55.631247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b50f990684417b00d9adf21b072ea', 'request_id': 'req-7bb156d9-cf0b-4a34-b661-a456f8593c60'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:55.642004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b50f990684417b00d9adf21b072ea', 'request_id': 'req-7bb156d9-cf0b-4a34-b661-a456f8593c60'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:55.664808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] The token cache is being invalidate because project 1f6b50f990684417b00d9adf21b072ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:46:55.665197 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:55.665922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7bb156d9-cf0b-4a34-b661-a456f8593c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:46:55.667876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1082/2194] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:46:55 2022] DELETE /identity/v3/projects/1f6b50f990684417b00d9adf21b072ea => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:55.672748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.673269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.673796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.701824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:55.703253 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:55.812245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1113/2195] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:55.823157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.823462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.823733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.862182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:55.866128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:55.888005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1083/2196] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:46:55.892841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.907790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eced772-b025-4c32-910c-5b93da3e8482 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.914753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.926142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.926655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.927251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.928011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:46:55.928395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.930627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:55.950591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1114/2197] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:46:55.955517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:55.971255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbef2f-0120-40d6-904b-88d3acf425cb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:55.988938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:55.989685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:55.989939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:55.990210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:55.990935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:55.992894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.032320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1084/2198] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:55 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:46:56.033715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.051029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e0eb-b065-4e13-a098-f890ddb3b8ef admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:56.138859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:56.139580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.139932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.140139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.140846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:56.142948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.167029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1115/2199] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:56 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:56.170821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.187813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84f46-5cf5-4593-a9c0-9f3cead7efb4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:56.195195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:56.196109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.196491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.196867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.197820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:56.203232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.242353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1085/2200] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:56.244363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.262440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48010ac-1c9e-4f7d-a4f4-5e21a530719f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:56.279659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:56.280386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.280677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.281205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.281960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:56.283805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bde31-9ac9-4735-9389-51ff67cd4694 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.288963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:56.316471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1116/2201] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:56.319015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.334626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf841b-5618-4b9f-80cf-b34c9b94dfbf admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:56.340916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:56.342360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.343274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.343793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] PATH_INFO: `/v3/projects/dfb5fd8b33c8480981b67d5a46654eea/users/00147e1b1c33460e84f61a1bd21ad1bb/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.382326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb5fd8b33c8480981b67d5a46654eea, user_id=00147e1b1c33460e84f61a1bd21ad1bb, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:56.385977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.415204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1086/2202] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:56 2022] PUT /identity/v3/projects/dfb5fd8b33c8480981b67d5a46654eea/users/00147e1b1c33460e84f61a1bd21ad1bb/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:56.426990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.427997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.428543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.533606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] MFA Rules not processed for user `00147e1b1c33460e84f61a1bd21ad1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:56.535011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:56.652549 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1117/2203] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:56.657062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.775320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948473bb-d6a4-43ac-b9d9-49eeabc6985a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:56.805723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:56.805723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:56.805723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:56.805723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:56.806290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:56.808858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:56.821883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:56.876931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1087/2204] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:46:56 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:56.882479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:56.897915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3331-882b-4149-b86e-5fceb85db57b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.012919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.013657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.013942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.014223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.014937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.026477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.066529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1118/2205] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:46:56 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:46:57.071308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.083706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2f1c9-b5a6-46e2-b573-4643dc096d54 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.092799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.093501 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.093760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.094074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.094878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.096849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.112967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1088/2206] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:57.114498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.126929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b15bed-43c3-4c34-b89f-a743191935a1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.133524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.134449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.134729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.135006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] PATH_INFO: `/v3/projects/d67439f656e24a0190be24b0fd9c0bbc/users/2ced5151d8b54cd98d1832fdaca6825e/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.156743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67439f656e24a0190be24b0fd9c0bbc, user_id=2ced5151d8b54cd98d1832fdaca6825e, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.159667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.182910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1119/2207] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:57 2022] PUT /identity/v3/projects/d67439f656e24a0190be24b0fd9c0bbc/users/2ced5151d8b54cd98d1832fdaca6825e/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:57.186027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.200604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3a06-bcfe-4b66-a8ec-ad7fcffe0e49 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.280317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.281015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.281304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.282166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.283172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.285503 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe763-5abd-422d-829d-cfc193fde463 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.299081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1089/2208] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:46:57.304241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.321101 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea081-3773-42b2-b06d-53d0efa05879 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.327663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.330098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.330098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.330406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] PATH_INFO: `/v3/projects/d67439f656e24a0190be24b0fd9c0bbc/users/2ced5151d8b54cd98d1832fdaca6825e/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.332760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67439f656e24a0190be24b0fd9c0bbc, user_id=2ced5151d8b54cd98d1832fdaca6825e, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.336446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.359792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1120/2209] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:46:57 2022] PUT /identity/v3/projects/d67439f656e24a0190be24b0fd9c0bbc/users/2ced5151d8b54cd98d1832fdaca6825e/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:46:57.361353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.361854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.361937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.392118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] MFA Rules not processed for user `2ced5151d8b54cd98d1832fdaca6825e`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:46:57.393411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:57.491246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1090/2210] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:46:57.501982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.503855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:57.562850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:57.586507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101c4a6-3ba1-4a40-8ea0-c5ebe53ac7c4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.590502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.591913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.592230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.592496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.605026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.607187 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.618427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1121/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:46:57.665581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:46:57.667003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:46:57.679319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619981b-1244-4851-bc4a-8b90b1bf582b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:46:57.683029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:46:57.683725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:46:57.684181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:46:57.684290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:46:57.766259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:46:57.767771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d88d2-0fbd-4c1f-8dfe-a05cdb5a003c service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:46:57.772300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:46:57.779452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1091/2212] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:01.477393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:01.595019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195086d-1fbc-4668-ad64-87c467eada15 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:01.595019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:01.595553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:01.595754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:01.596226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] PATH_INFO: `/v3/users/00147e1b1c33460e84f61a1bd21ad1bb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:01.598612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00147e1b1c33460e84f61a1bd21ad1bb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:01.602705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:01.668747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00147e1b1c33460e84f61a1bd21ad1bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:01.682340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00147e1b1c33460e84f61a1bd21ad1bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:01.696263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00147e1b1c33460e84f61a1bd21ad1bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:01.696964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00147e1b1c33460e84f61a1bd21ad1bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:01.704698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00147e1b1c33460e84f61a1bd21ad1bb'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:01.711421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1122/2213] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:01 2022] DELETE /identity/v3/users/00147e1b1c33460e84f61a1bd21ad1bb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:01.716133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:01.716604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:01.716810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:01.734463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:01.735797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:01.805134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1092/2214] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:01.815196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:01.818340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:01.881176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4a2f-ba50-4b3e-b227-e0075bc099c0 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:01.884863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:01.885517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:01.885798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:01.886073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:01.895052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:01.896560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:01.906947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1123/2215] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:02.266266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:02.269835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:02.289182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be61bd-93dc-4d59-a6b2-2dc3736d52ee None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:02.294322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:02.295329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:02.295769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:02.296211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] PATH_INFO: `/v3/projects/dfb5fd8b33c8480981b67d5a46654eea` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:02.297810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb5fd8b33c8480981b67d5a46654eea)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:02.299865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:02.383323 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb5fd8b33c8480981b67d5a46654eea', 'request_id': 'req-ca0841d1-d547-43b5-ae43-1bde58e01954'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.390120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb5fd8b33c8480981b67d5a46654eea', 'request_id': 'req-ca0841d1-d547-43b5-ae43-1bde58e01954'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.399781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb5fd8b33c8480981b67d5a46654eea', 'request_id': 'req-ca0841d1-d547-43b5-ae43-1bde58e01954'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.413131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] The token cache is being invalidate because project dfb5fd8b33c8480981b67d5a46654eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:02.413429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.414196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.419392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1093/2216] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:02 2022] DELETE /identity/v3/projects/dfb5fd8b33c8480981b67d5a46654eea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:47:02.420371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:02.429139 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:02.438469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5dd33-1826-4bde-85af-833df37070a6 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:02.511689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:02.513431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:02.514145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:02.514460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] PATH_INFO: `/v3/users/2ced5151d8b54cd98d1832fdaca6825e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:02.517538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ced5151d8b54cd98d1832fdaca6825e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:02.521446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:02.584964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ced5151d8b54cd98d1832fdaca6825e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.611338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ced5151d8b54cd98d1832fdaca6825e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.630740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ced5151d8b54cd98d1832fdaca6825e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.631645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ced5151d8b54cd98d1832fdaca6825e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.642020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8f7a8347-2a3d-4efa-a1a6-10ff55b5c6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ced5151d8b54cd98d1832fdaca6825e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:02.649416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1124/2217] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:02 2022] DELETE /identity/v3/users/2ced5151d8b54cd98d1832fdaca6825e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:03.043935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.045425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:03.061733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0841d1-d547-43b5-ae43-1bde58e01954 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.124263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.125060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.125345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.125625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] PATH_INFO: `/v3/projects/d67439f656e24a0190be24b0fd9c0bbc` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.126804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67439f656e24a0190be24b0fd9c0bbc)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.128760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.154155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:03.177137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67439f656e24a0190be24b0fd9c0bbc', 'request_id': 'req-5bcf4a21-ddab-411e-8fbd-68d953c3709d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:03.183159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67439f656e24a0190be24b0fd9c0bbc', 'request_id': 'req-5bcf4a21-ddab-411e-8fbd-68d953c3709d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:03.189761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67439f656e24a0190be24b0fd9c0bbc', 'request_id': 'req-5bcf4a21-ddab-411e-8fbd-68d953c3709d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:03.201636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] The token cache is being invalidate because project d67439f656e24a0190be24b0fd9c0bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:03.201927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:03.202549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-5bcf4a21-ddab-411e-8fbd-68d953c3709d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:03.204177 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1094/2218] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:03 2022] DELETE /identity/v3/projects/d67439f656e24a0190be24b0fd9c0bbc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:03.209084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.209376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.209655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.227415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:03.228612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:03.289405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1125/2219] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:03.297265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.297562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.297843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.316132 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:03.317926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:03.325794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1095/2220] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:03.329817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.339877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111279-2e64-4f77-8e75-4a8ed902f711 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.344501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.345188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.345476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.345760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.346493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:03.346805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.349434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.362414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1126/2221] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:03.367336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.376643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f458ff-8146-41cf-8857-b6a92f716b03 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.381825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.382477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.382760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.383038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.383770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.385725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.411976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1096/2222] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:03.416218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.427058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc4cd-a209-4973-9e08-752982a16331 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.434833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:03.485796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.486469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.486755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.487034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.487771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.490484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.510036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1127/2223] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:03.514048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.525008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3705f7a-574a-4fa2-b9f4-d9a0a1202f37 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.529687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.530348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.530637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.530921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.531689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.533300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.544337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1097/2224] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:03.548380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.558682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1313a-b314-4bac-9dc3-ac86c82ca1ce admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.563386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.564040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.564325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.564604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.565334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.567656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd2e31-2ed4-4f31-a235-0e28fad2cfd5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.577667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1128/2225] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:03.581708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.592351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09f78d-c173-495d-bdbf-3c6475f7d407 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.596966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.597838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.598195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.598474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] PATH_INFO: `/v3/projects/f296477a37e149ceab1c4de8cc0010ae/users/93fef7f67b9544fea55291483e067703/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.614450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f296477a37e149ceab1c4de8cc0010ae, user_id=93fef7f67b9544fea55291483e067703, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.617135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.642500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1098/2226] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:03 2022] PUT /identity/v3/projects/f296477a37e149ceab1c4de8cc0010ae/users/93fef7f67b9544fea55291483e067703/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:03.644116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687700df-b535-46e1-8c11-205339691798 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.644414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687700df-b535-46e1-8c11-205339691798 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.644743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687700df-b535-46e1-8c11-205339691798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.680562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-687700df-b535-46e1-8c11-205339691798 None None] MFA Rules not processed for user `93fef7f67b9544fea55291483e067703`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:03.683334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-687700df-b535-46e1-8c11-205339691798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:03.768008 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1129/2227] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:03.773173 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.870203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d6e8d-7376-4618-9df6-7afe88d4fb63 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:03.880295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:03.880904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:03.881437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:03.881773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:03.896964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:03.899571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:03.965908 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1099/2228] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:03.967465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687700df-b535-46e1-8c11-205339691798 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:03.981933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687700df-b535-46e1-8c11-205339691798 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.069915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.070862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.071222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.071506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.072219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.074180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.099257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1130/2229] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:03 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:04.100775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.112678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71d3f9-9abc-41ea-944a-e2017aa7c12a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.118064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.119200 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.119657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.119961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.120787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.122392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.133463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1100/2230] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:04.137852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.148497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afb466-1024-4c24-b84f-06f511d25ed5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.153622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.154719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.155072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.155393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] PATH_INFO: `/v3/projects/294ce5732785416ca8c104782906ab04/users/b32a8faabc534eb29e41c6d66732cb2f/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.165517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:04.173900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294ce5732785416ca8c104782906ab04, user_id=b32a8faabc534eb29e41c6d66732cb2f, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.176953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.190090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1131/2231] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:04 2022] PUT /identity/v3/projects/294ce5732785416ca8c104782906ab04/users/b32a8faabc534eb29e41c6d66732cb2f/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:04.194382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.204155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006e6bb-db32-4cba-89de-4c7ffeebb4d5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.222449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:04.262774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.263509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.263787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.264059 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.264778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.266359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2d28f-4b78-4c09-93da-7ad29324c105 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.276817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1101/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:04.281083 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.292341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5850-df96-4961-94be-f4157ae5c631 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.297720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.298793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.299201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.299837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] PATH_INFO: `/v3/projects/294ce5732785416ca8c104782906ab04/users/b32a8faabc534eb29e41c6d66732cb2f/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.302193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294ce5732785416ca8c104782906ab04, user_id=b32a8faabc534eb29e41c6d66732cb2f, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.305136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.316266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1132/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:04 2022] PUT /identity/v3/projects/294ce5732785416ca8c104782906ab04/users/b32a8faabc534eb29e41c6d66732cb2f/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:04.327079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.327450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.327733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.355563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] MFA Rules not processed for user `b32a8faabc534eb29e41c6d66732cb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:04.357088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:04.425663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1102/2234] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:04.438452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.440174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:04.506780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70972-77fc-4daf-a969-627e431f3121 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.510540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.511558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.511892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.512166 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.523314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.524789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.534506 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1133/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:04.619088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:04.628881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe688-e884-495d-bb36-0a422590de73 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:04.633034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:04.633667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:04.633946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:04.634219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:04.692841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:04.693781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:04.703346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1103/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:06.194110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:06.195605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:06.251216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:06.254084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:06.343764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f3b4-3e48-4c6a-a558-9d2d7862c5df service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:06.359092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:06.362069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:06.362697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:06.363427 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] PATH_INFO: `/v3/users/d488a02933c04e79ad1caa8c3f64fc3c` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:06.365897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d488a02933c04e79ad1caa8c3f64fc3c)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:06.372163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:06.420898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:06.460941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f3038-a65d-4495-a29b-c255b292a8b5 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:06.469421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:06.470745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:06.471172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:06.471607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] PATH_INFO: `/v3/users/417d65d73430478ebaee12f3e648f82b` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:06.473386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=417d65d73430478ebaee12f3e648f82b)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:06.475521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:06.497028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd488a02933c04e79ad1caa8c3f64fc3c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.511252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd488a02933c04e79ad1caa8c3f64fc3c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.553657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd488a02933c04e79ad1caa8c3f64fc3c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.554731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd488a02933c04e79ad1caa8c3f64fc3c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.557490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417d65d73430478ebaee12f3e648f82b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.559406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417d65d73430478ebaee12f3e648f82b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.562959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:06.570077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1eed9796-8da4-445b-aa85-01e310f2c25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd488a02933c04e79ad1caa8c3f64fc3c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.574931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417d65d73430478ebaee12f3e648f82b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.584888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1134/2237] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:06 2022] DELETE /identity/v3/users/d488a02933c04e79ad1caa8c3f64fc3c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:06.592899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:06.593342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:06.593638 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:06.635683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417d65d73430478ebaee12f3e648f82b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.652673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:06.654412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:06.673928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417d65d73430478ebaee12f3e648f82b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:06.687482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1104/2238] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:06 2022] DELETE /identity/v3/users/417d65d73430478ebaee12f3e648f82b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:06.761321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1135/2239] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:06.778705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:06.780245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:06.907429 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1246-f94e-4330-bdf0-b1bea31ae51b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:06.914280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:06.914280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:06.914280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:06.914280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:06.915644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:06.917192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:06.934635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1847e-5d4b-405f-ad1b-b63ef0d45191 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:07.013345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:07.015066 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:07.019693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:07.021289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:07.021575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:07.021854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] PATH_INFO: `/v3/projects/b8d8cec3dc2b44518be41f86e8cecaac` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:07.023074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d8cec3dc2b44518be41f86e8cecaac)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:07.025030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:07.032198 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1105/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:07.082151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d8cec3dc2b44518be41f86e8cecaac', 'request_id': 'req-b626079e-110b-4cb9-b100-e0ad453cf15c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.093850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d8cec3dc2b44518be41f86e8cecaac', 'request_id': 'req-b626079e-110b-4cb9-b100-e0ad453cf15c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.103598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d8cec3dc2b44518be41f86e8cecaac', 'request_id': 'req-b626079e-110b-4cb9-b100-e0ad453cf15c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.125751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] The token cache is being invalidate because project b8d8cec3dc2b44518be41f86e8cecaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:07.126129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.128296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.132470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1136/2241] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:06 2022] DELETE /identity/v3/projects/b8d8cec3dc2b44518be41f86e8cecaac => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:47:07.136401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:07.147605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c0a0-53d7-46b7-b059-2d0338d2ecb7 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:07.156829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:07.236202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:07.237591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:07.238084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:07.238569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] PATH_INFO: `/v3/users/d0011f2463304b17957236619f08dd80` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:07.241137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0011f2463304b17957236619f08dd80)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:07.243758 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:07.309505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0011f2463304b17957236619f08dd80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.310469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0011f2463304b17957236619f08dd80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.321798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0011f2463304b17957236619f08dd80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.334996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0011f2463304b17957236619f08dd80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.370572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0011f2463304b17957236619f08dd80'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.383025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1106/2242] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:07 2022] DELETE /identity/v3/users/d0011f2463304b17957236619f08dd80 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:07.625244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:07.627258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:07.681729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626079e-110b-4cb9-b100-e0ad453cf15c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:07.741146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:07.742592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:07.752646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:07.877658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:07.878541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:07.878818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:07.879879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] PATH_INFO: `/v3/projects/5d7ffdf6deff4fa89a282804f01f97b7` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:07.881226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7ffdf6deff4fa89a282804f01f97b7)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:07.884337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:07.905871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b53b5-ca2e-4cef-aa5f-0649fdea0403 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:07.924380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:07.925460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:07.925896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:07.926949 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] PATH_INFO: `/v3/projects/ee51de93c02b433cb3055abb990d565f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:07.928919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee51de93c02b433cb3055abb990d565f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:07.931060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:07.963902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7ffdf6deff4fa89a282804f01f97b7', 'request_id': 'req-90482a00-00e4-43f5-a012-d881b0a43097'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.983240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7ffdf6deff4fa89a282804f01f97b7', 'request_id': 'req-90482a00-00e4-43f5-a012-d881b0a43097'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:07.999949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7ffdf6deff4fa89a282804f01f97b7', 'request_id': 'req-90482a00-00e4-43f5-a012-d881b0a43097'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.021279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:08.028006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] The token cache is being invalidate because project 5d7ffdf6deff4fa89a282804f01f97b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:08.028331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.030044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.033646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1137/2243] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:07 2022] DELETE /identity/v3/projects/5d7ffdf6deff4fa89a282804f01f97b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:08.071679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee51de93c02b433cb3055abb990d565f', 'request_id': 'req-0e33f0e6-6018-4aae-8e18-244a238c69e5'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.109509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee51de93c02b433cb3055abb990d565f', 'request_id': 'req-0e33f0e6-6018-4aae-8e18-244a238c69e5'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.130582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee51de93c02b433cb3055abb990d565f', 'request_id': 'req-0e33f0e6-6018-4aae-8e18-244a238c69e5'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.159204 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] The token cache is being invalidate because project ee51de93c02b433cb3055abb990d565f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:08.159497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.168951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0e33f0e6-6018-4aae-8e18-244a238c69e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:08.171261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1107/2244] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:07 2022] DELETE /identity/v3/projects/ee51de93c02b433cb3055abb990d565f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:09.404843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:09.406452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:09.474780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90482a00-00e4-43f5-a012-d881b0a43097 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:09.534046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:09.534966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:09.535802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:09.536082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] PATH_INFO: `/v3/users/96d4f76426684dc28d6f34e936f19c15` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:09.537297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d4f76426684dc28d6f34e936f19c15)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:09.539273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:09.542491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:09.594465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d4f76426684dc28d6f34e936f19c15'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:09.603761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d4f76426684dc28d6f34e936f19c15'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:09.617359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d4f76426684dc28d6f34e936f19c15'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:09.618022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d4f76426684dc28d6f34e936f19c15'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:09.625210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d4f76426684dc28d6f34e936f19c15'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:09.631884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1138/2245] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:09 2022] DELETE /identity/v3/users/96d4f76426684dc28d6f34e936f19c15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:09.636400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cdfb-2a2d-4271-b7bc-29db6899bd96 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:09.636864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cdfb-2a2d-4271-b7bc-29db6899bd96 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:09.636955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cdfb-2a2d-4271-b7bc-29db6899bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:09.656599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-3963cdfb-2a2d-4271-b7bc-29db6899bd96 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:09.657776 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3963cdfb-2a2d-4271-b7bc-29db6899bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:09.720136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1108/2246] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:09.729894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:09.731632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:09.815712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620ff35-021a-4040-9aa0-89455705bf98 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:09.821713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:09.822623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:09.822920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:09.823354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:09.831668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:09.831975 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:09.832891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:09.839346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:09.841865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:09.852484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:09.855355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:09.857272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1139/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:09.930827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1109/2248] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:09.978974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:09.980627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.059856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7711ed-e450-43ed-80d9-fe57d7f0370c service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.065236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.065910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.066189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.066465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.075772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.077431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40615147-b3e0-4813-891d-1c01234b7f7f service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.086575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1140/2249] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:10.169375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.171235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.193703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fe447-8a0a-4e9b-b473-a7295202cb6d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.208883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.210392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.210797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.211154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] PATH_INFO: `/v3/projects/0cdad657dbf94cdaa34cc96c662c555d` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.213091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdad657dbf94cdaa34cc96c662c555d)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.215651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.292252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdad657dbf94cdaa34cc96c662c555d', 'request_id': 'req-d6a71f87-67f3-4930-8d7e-b081d05b451b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.313039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdad657dbf94cdaa34cc96c662c555d', 'request_id': 'req-d6a71f87-67f3-4930-8d7e-b081d05b451b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.328887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdad657dbf94cdaa34cc96c662c555d', 'request_id': 'req-d6a71f87-67f3-4930-8d7e-b081d05b451b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.330764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:10.349367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] The token cache is being invalidate because project 0cdad657dbf94cdaa34cc96c662c555d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:10.350069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.351285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.354199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1110/2250] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:10 2022] DELETE /identity/v3/projects/0cdad657dbf94cdaa34cc96c662c555d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:10.359361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb15b4-914e-4a9c-93e5-769cc7fd805d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.359724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb15b4-914e-4a9c-93e5-769cc7fd805d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.360069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb15b4-914e-4a9c-93e5-769cc7fd805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.382794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-7beb15b4-914e-4a9c-93e5-769cc7fd805d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:10.385078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7beb15b4-914e-4a9c-93e5-769cc7fd805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.395359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:10.433680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.436051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.474156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1141/2251] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:10.482077 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.482779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.483721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.508220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:10.510902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.521701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1142/2252] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:10.525975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.542090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5bbb-3af0-4952-a58b-8872141f5aa1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.546919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.547948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.548234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.548643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.548747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a71f87-67f3-4930-8d7e-b081d05b451b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.549639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:10.550143 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.553012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.559405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.560789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.561090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.561371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] PATH_INFO: `/v3/users/93fef7f67b9544fea55291483e067703` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.563448 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93fef7f67b9544fea55291483e067703)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.565650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.567987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1143/2253] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:10.571885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.581728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d34a3-7ce0-4ad1-8492-b2a794ef4bb4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.587296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.588025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.588375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.588725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.589964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.591492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.624173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1144/2254] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:47:10.628344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.636922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93fef7f67b9544fea55291483e067703'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.637912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93fef7f67b9544fea55291483e067703'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.650216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93fef7f67b9544fea55291483e067703'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.665447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93fef7f67b9544fea55291483e067703'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.698282 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1c240a08-a247-462f-bd1a-a2cf24d472a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93fef7f67b9544fea55291483e067703'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:10.709505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780edb8-6771-4184-b61a-6e68ac71c7d8 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.711921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1111/2255] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:10 2022] DELETE /identity/v3/users/93fef7f67b9544fea55291483e067703 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:47:10.716130 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.716445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.716699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.740741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:10.742123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.787929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.788678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.788974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.789300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.790013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.792537 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.823458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1145/2256] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:10 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:47:10.827531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.830633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1112/2257] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:10.830760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.838037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.840883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:10.842992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a913-c3f1-4543-a44a-a921daa037ec admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.849681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.850524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.850821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.851098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.851908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.854001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:10.854287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.859477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:10.876790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1146/2258] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:47:10.877743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.892786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b71cc-7f2d-428a-9cf6-973d0f590822 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.906079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.906765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.907048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.907365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.908158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.909835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.931770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1147/2259] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:10.932723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:10.951381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e45f5-24e5-4719-a7d3-d042f3b4e7fc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.954741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e45c5-3132-4273-a11c-fd4123643b1a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:10.958266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.959298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.959584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.959871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] PATH_INFO: `/v3/projects/2a58f7fb42ee42b49a65743c9fb131c7/users/e5e08a8fda33483bb71cd5fc00dac88e/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.960340 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:10.961145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:10.961561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:10.961969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:10.975110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:10.977962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc792f4-f041-48f9-96e3-ae322f35e1fe service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:10.996775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a58f7fb42ee42b49a65743c9fb131c7, user_id=e5e08a8fda33483bb71cd5fc00dac88e, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:11.000497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:11.003043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1113/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:47:11.030319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1148/2261] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:10 2022] PUT /identity/v3/projects/2a58f7fb42ee42b49a65743c9fb131c7/users/e5e08a8fda33483bb71cd5fc00dac88e/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:11.032111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:11.032403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:11.032695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:11.084206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] MFA Rules not processed for user `e5e08a8fda33483bb71cd5fc00dac88e`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:11.085766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:11.196226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1114/2262] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:11.211112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:11.213683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:11.366181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869205c-8fa3-4bfb-8f65-f6e7baf31377 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:11.370513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:11.371460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:11.371813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:11.372165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:11.416989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:11.417126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:11.430669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1149/2263] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:11.609552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:11.611060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:11.774181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629db36-2be0-4192-b686-d26ca3d7e596 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:11.779612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:11.780496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:11.780825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:11.781156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] PATH_INFO: `/v3/projects/f296477a37e149ceab1c4de8cc0010ae` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:11.782369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f296477a37e149ceab1c4de8cc0010ae)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:11.785883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:11.870320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:11.878245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f296477a37e149ceab1c4de8cc0010ae', 'request_id': 'req-c5059541-4bdf-412d-94fa-3272a6b26da6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:11.888038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f296477a37e149ceab1c4de8cc0010ae', 'request_id': 'req-c5059541-4bdf-412d-94fa-3272a6b26da6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:11.903876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f296477a37e149ceab1c4de8cc0010ae', 'request_id': 'req-c5059541-4bdf-412d-94fa-3272a6b26da6'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:11.927396 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] The token cache is being invalidate because project f296477a37e149ceab1c4de8cc0010ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:11.928131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:11.936566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:11.940098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1115/2264] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:11 2022] DELETE /identity/v3/projects/f296477a37e149ceab1c4de8cc0010ae => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:11.944641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:11.956584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813af28-7071-46fa-868d-a7a4c8f6631a service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:12.034972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:12.036535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:12.036912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:12.037273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] PATH_INFO: `/v3/users/b32a8faabc534eb29e41c6d66732cb2f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:12.039240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32a8faabc534eb29e41c6d66732cb2f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:12.041328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:12.126305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32a8faabc534eb29e41c6d66732cb2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.140879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32a8faabc534eb29e41c6d66732cb2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.154841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:12.161554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32a8faabc534eb29e41c6d66732cb2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.163785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32a8faabc534eb29e41c6d66732cb2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.186324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-243063dd-a9be-419d-ba8c-1e66cea8a429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32a8faabc534eb29e41c6d66732cb2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.198572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1150/2265] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:11 2022] DELETE /identity/v3/users/b32a8faabc534eb29e41c6d66732cb2f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:12.520560 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:12.522140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:12.543297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059541-4bdf-412d-94fa-3272a6b26da6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:12.620876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:12.621863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:12.622441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:12.622787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] PATH_INFO: `/v3/projects/294ce5732785416ca8c104782906ab04` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:12.624653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294ce5732785416ca8c104782906ab04)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:12.626603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:12.684834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294ce5732785416ca8c104782906ab04', 'request_id': 'req-a6a978c6-dee9-4448-9332-aa6fac951f65'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.693533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294ce5732785416ca8c104782906ab04', 'request_id': 'req-a6a978c6-dee9-4448-9332-aa6fac951f65'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.706965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294ce5732785416ca8c104782906ab04', 'request_id': 'req-a6a978c6-dee9-4448-9332-aa6fac951f65'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.722609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] The token cache is being invalidate because project 294ce5732785416ca8c104782906ab04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:12.723581 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.724468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-a6a978c6-dee9-4448-9332-aa6fac951f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:12.726799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1116/2266] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:12 2022] DELETE /identity/v3/projects/294ce5732785416ca8c104782906ab04 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:12.732764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:12.733088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:12.733382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:12.781332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:12.782914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:12.972209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1151/2267] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:13.079393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.079956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.080044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.115303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:13.118428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:13.128715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1117/2268] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:13.133713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.145327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94fd1-4bfb-4c2b-b23a-f7f6e8cc2844 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.151055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.151923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.152406 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.152796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.153707 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:13.154156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.156392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.172642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1152/2269] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:13.177414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.188280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca1bde-07b0-423b-9ca7-4307aec07a74 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.194373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.195382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.195800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.196209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.197241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.199465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.239208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1118/2270] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:13 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:13.240428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.252317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c8bd-6be2-44a9-b980-5517f267fc5a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.328151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.329153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.329612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.330045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.330637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.339805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.366264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1153/2271] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:13 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:13.370991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.386318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d012-78e6-4559-9873-1b0b049bbf5b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.393559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.394272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.394585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.395626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.396374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.398592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.414341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1119/2272] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:13.415540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.427269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32821fb-d886-4803-9419-4ca4507ee53f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.432273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.433227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.433364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.433649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.434448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.436103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba525b79-d5c6-44b1-861b-3d2e639a8641 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.451205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1154/2273] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:13.456461 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.470359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1984-32c0-411a-919a-7b2d8c22fba3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.475352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.476349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.476655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.477064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] PATH_INFO: `/v3/projects/c9c573e122c8446c9044785c62a47baa/users/510cdedc08434435b1938e12c25ed425/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.495594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c573e122c8446c9044785c62a47baa, user_id=510cdedc08434435b1938e12c25ed425, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.498291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.508981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:13.517054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1120/2274] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:13 2022] PUT /identity/v3/projects/c9c573e122c8446c9044785c62a47baa/users/510cdedc08434435b1938e12c25ed425/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:13.532994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.533294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.533578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.563890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] MFA Rules not processed for user `510cdedc08434435b1938e12c25ed425`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:13.565184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:13.617154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:13.651055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1155/2275] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:13.663926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:13.665868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:13.743175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d0c4-d108-4e3f-a30c-afc569a0564f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:13.747490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:13.748107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:13.748393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:13.748668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:13.760514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:13.762187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb827be-c7ab-4d0e-ab2f-7cbd83cde37e service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:13.784802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1121/2276] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:19.078719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:19.177132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297448-addc-4c94-be95-00f7f8037ff9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:19.182947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:19.184226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:19.184675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:19.185138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] PATH_INFO: `/v3/users/510cdedc08434435b1938e12c25ed425` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:19.186865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510cdedc08434435b1938e12c25ed425)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:19.189104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:19.258081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510cdedc08434435b1938e12c25ed425'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:19.275675 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510cdedc08434435b1938e12c25ed425'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:19.290899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510cdedc08434435b1938e12c25ed425'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:19.292499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510cdedc08434435b1938e12c25ed425'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:19.301306 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510cdedc08434435b1938e12c25ed425'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:19.309400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1156/2277] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:19 2022] DELETE /identity/v3/users/510cdedc08434435b1938e12c25ed425 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:19.314467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:19.315452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:19.315961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:19.340136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:19.341616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:19.423391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1122/2278] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:19.433491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:19.434871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:19.508262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa4b7-b4f3-4f23-8d6a-e3de5345f258 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:19.518578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:19.521202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:19.522036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:19.523200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:19.534914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:19.536521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:19.551237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1157/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:19.980109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:19.989272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:20.018847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcdd7f-639b-4aaf-831c-0b5689bf56cd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:20.029561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:20.044827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:20.045242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:20.045601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] PATH_INFO: `/v3/projects/c9c573e122c8446c9044785c62a47baa` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:20.047868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c573e122c8446c9044785c62a47baa)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:20.051424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:20.185124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c573e122c8446c9044785c62a47baa', 'request_id': 'req-f9cce561-6971-44cd-930a-8161c7f19289'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:20.196071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c573e122c8446c9044785c62a47baa', 'request_id': 'req-f9cce561-6971-44cd-930a-8161c7f19289'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:20.212499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c573e122c8446c9044785c62a47baa', 'request_id': 'req-f9cce561-6971-44cd-930a-8161c7f19289'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:20.242880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] The token cache is being invalidate because project c9c573e122c8446c9044785c62a47baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:20.243796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:20.244707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f9cce561-6971-44cd-930a-8161c7f19289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:20.263747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1123/2280] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:19 2022] DELETE /identity/v3/projects/c9c573e122c8446c9044785c62a47baa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:23.810262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:23.811718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:23.822897 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:23.826931 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30adf0-f084-4d30-a56b-0b3ac3e284e3 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:23.909273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:23.910653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:23.910938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:23.911249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] PATH_INFO: `/v3/users/e5e08a8fda33483bb71cd5fc00dac88e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:23.917650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e08a8fda33483bb71cd5fc00dac88e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:23.917650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:24.043569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e08a8fda33483bb71cd5fc00dac88e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.052205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e08a8fda33483bb71cd5fc00dac88e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.070826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e08a8fda33483bb71cd5fc00dac88e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.076006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e08a8fda33483bb71cd5fc00dac88e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.081454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e08a8fda33483bb71cd5fc00dac88e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.088447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1158/2281] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:23 2022] DELETE /identity/v3/users/e5e08a8fda33483bb71cd5fc00dac88e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:24.093194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:24.093710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:24.093865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:24.113715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:24.115415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:24.138963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:24.200806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1124/2282] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:24.207411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:24.208969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:24.311976 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ce84e-8a83-4caf-b0e9-5767bafdd954 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:24.317900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:24.318573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:24.318857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:24.319161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:24.347918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:24.350200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715bf59-1122-4e18-8ad0-a5e8eaefd524 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:24.366691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1159/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:24.744574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:24.746216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:24.775472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf7458-6cf6-4e3f-ade3-ec6b5600f9cc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:24.786694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:24.787667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:24.787991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:24.788277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] PATH_INFO: `/v3/projects/2a58f7fb42ee42b49a65743c9fb131c7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:24.789495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a58f7fb42ee42b49a65743c9fb131c7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:24.791568 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:24.855058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a58f7fb42ee42b49a65743c9fb131c7', 'request_id': 'req-78c88c06-59ac-413e-8a46-b38de1a77a43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.861965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a58f7fb42ee42b49a65743c9fb131c7', 'request_id': 'req-78c88c06-59ac-413e-8a46-b38de1a77a43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.871660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a58f7fb42ee42b49a65743c9fb131c7', 'request_id': 'req-78c88c06-59ac-413e-8a46-b38de1a77a43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.883490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] The token cache is being invalidate because project 2a58f7fb42ee42b49a65743c9fb131c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:24.883778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.884445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78c88c06-59ac-413e-8a46-b38de1a77a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:24.886011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1125/2284] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:24 2022] DELETE /identity/v3/projects/2a58f7fb42ee42b49a65743c9fb131c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:24.891001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:24.891574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:24.891816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:24.916463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:24.917988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:24.947359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:25.003215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1160/2285] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:25.012437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.012729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.013015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.034348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:25.035744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:25.053772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1126/2286] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:25.058145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.073969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e0861-d34c-4fca-a7ed-231e168d888e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.079345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.080593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.081102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.081593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.082613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:25.083194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.085444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.106898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1161/2287] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:25.108149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.119048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4498c7-c644-459d-a773-607d4a99adf8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.126857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.127613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.127900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.128178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.129912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.132237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.164812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1127/2288] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:25 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:25.168816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.185844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb3735-1a72-42a4-aa67-e0f5922b02d4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.299272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.300768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.301273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.301681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.302776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.305152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.338017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1162/2289] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:25 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:47:25.343759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.367530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac3b5b-7ad3-47a6-8603-64a28ec4c3b9 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.373895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.375231 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.375682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.376118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.377075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.379115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.394043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1128/2290] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:25.395423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.417636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0734-a2ad-4bcf-ad02-5fc8ba8fedac admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.432490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.433183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.433464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.433741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.434479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.436118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842b671-8ae8-474b-bd64-203a0bdd84b5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.451217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1163/2291] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:25.454414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.466255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97f9dd-b006-451e-bc41-f1895543d339 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.472122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.473781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.474178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.475399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] PATH_INFO: `/v3/projects/a8680f6d26dd4f3d8e4167a5d7ffeb55/users/da0f8e1ea3f447428171f15f8fdc992d/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.492050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8680f6d26dd4f3d8e4167a5d7ffeb55, user_id=da0f8e1ea3f447428171f15f8fdc992d, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.494941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.510542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1129/2292] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:25 2022] PUT /identity/v3/projects/a8680f6d26dd4f3d8e4167a5d7ffeb55/users/da0f8e1ea3f447428171f15f8fdc992d/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:25.520873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf6f3-00c0-4f1a-bd56-0d012deafd04 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.521259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf6f3-00c0-4f1a-bd56-0d012deafd04 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.521605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf6f3-00c0-4f1a-bd56-0d012deafd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.557860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0b2bf6f3-00c0-4f1a-bd56-0d012deafd04 None None] MFA Rules not processed for user `da0f8e1ea3f447428171f15f8fdc992d`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:25.559250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0b2bf6f3-00c0-4f1a-bd56-0d012deafd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:25.646266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1164/2293] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:25.663412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:25.665997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:25.741003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:25.757588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85712314-471a-44f4-abc8-dad26f705b6c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:25.761873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:25.762636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:25.762991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:25.763366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:25.774434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:25.776299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:25.791708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1130/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:47:29.259761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52c6e-a59a-4bba-887a-907d85225947 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:29.260609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52c6e-a59a-4bba-887a-907d85225947 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:29.260609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52c6e-a59a-4bba-887a-907d85225947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:29.282825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a8e52c6e-a59a-4bba-887a-907d85225947 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:29.284363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a8e52c6e-a59a-4bba-887a-907d85225947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:29.300656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:29.389656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1165/2295] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:29.405294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:29.406906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:29.514726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2b03-b658-4d49-91c8-851b888010c1 service glance] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:29.529023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:29.529680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:29.529999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:29.530280 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:29.541283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:29.551841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670231e-7979-4a81-bad1-ba643bef7746 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:29.553989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1131/2296] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:47:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:31.784220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:31.784771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:31.784771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:31.786459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1166/2297] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:47:31.796625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:31.797157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:31.797247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:31.816760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] MFA Rules not processed for user `48e5ad200c9f4c00b971765eff2b194a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:31.817939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:31.901274 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1132/2298] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:47:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:31.906012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:31.908080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:31.919705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:31.921098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:31.934584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ad60a-a7c1-4500-b8e9-3f17e3982d56 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:31.940110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:31.940765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:31.941053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:31.941333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:31.951113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:31.952739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:31.963968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1133/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:31.983786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc813f24-0372-409d-943a-53ed1c0f7854 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:31.989147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:31.990758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:31.991117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:31.991505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] PATH_INFO: `/v3/users/812f6eb44b7744da935716688523160c` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:31.992837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812f6eb44b7744da935716688523160c)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:31.995050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.045103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812f6eb44b7744da935716688523160c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.052486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812f6eb44b7744da935716688523160c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.065248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812f6eb44b7744da935716688523160c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.066052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812f6eb44b7744da935716688523160c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.073498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ea3585a7-7caa-48c7-8c33-36458823ce63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812f6eb44b7744da935716688523160c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.079777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1167/2300] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:31 2022] DELETE /identity/v3/users/812f6eb44b7744da935716688523160c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:32.303573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.315515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dd7b-4f20-46b4-8f13-c03f7a13f4f9 service placement] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.395342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.396744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.396996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.397353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] PATH_INFO: `/v3/projects/5bb2bef6e3d3434d9c70d88306749a02` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.398491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb2bef6e3d3434d9c70d88306749a02)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.400453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.402051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:32.448922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb2bef6e3d3434d9c70d88306749a02', 'request_id': 'req-149bb7e6-3041-4d03-aebc-321ebbb66c43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.457056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb2bef6e3d3434d9c70d88306749a02', 'request_id': 'req-149bb7e6-3041-4d03-aebc-321ebbb66c43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.468294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb2bef6e3d3434d9c70d88306749a02', 'request_id': 'req-149bb7e6-3041-4d03-aebc-321ebbb66c43'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.480426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] The token cache is being invalidate because project 5bb2bef6e3d3434d9c70d88306749a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:32.480714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.481638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-149bb7e6-3041-4d03-aebc-321ebbb66c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:32.483419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1134/2301] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:32 2022] DELETE /identity/v3/projects/5bb2bef6e3d3434d9c70d88306749a02 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:32.489080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.489401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.489686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.508058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:32.509271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:32.551836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:32.573248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1168/2302] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:32.581421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.581678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.581964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.602209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:32.603473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:32.611663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1135/2303] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:32.615929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.625599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949fed2-e3e9-450e-9505-4e7c2dfaeba6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.630348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.631185 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.631474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.631753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.632492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:32.632804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.634690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.648903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1169/2304] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:32.653220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.663415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2db528-f105-4d8b-9133-240bb540da8e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.668159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.668816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.669102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.669408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.670116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.672048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.699689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1136/2305] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:32 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:32.704140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.715490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d6df-9068-4904-abc0-2db5a62a7668 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.775199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.775887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.776170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.776448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.777154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.779103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.800353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1170/2306] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:32 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:32.805951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.817380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80765214-648a-43ca-b654-1717815f81c3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.822426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.823091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.823447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.823726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.824454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.826071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.837107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1137/2307] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:32.841240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.853244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd2b8-dc50-43e9-b284-726888f5d15c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.858669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.859384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.859666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.859942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.860709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.862314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60345f7a-c291-4393-9040-a51cebe8a48d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.873698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1171/2308] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:32.877989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:32.888436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e2b7d-d2e3-4e97-8772-d2d5cd36ee15 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:32.893725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:32.894611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.895106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.895294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] PATH_INFO: `/v3/projects/4761b86859554c3984b4507a58e1308c/users/b8d48da2258d4de8958746c92a99d00f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.913471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4761b86859554c3984b4507a58e1308c, user_id=b8d48da2258d4de8958746c92a99d00f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:32.916493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:32.932387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1138/2309] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:32 2022] PUT /identity/v3/projects/4761b86859554c3984b4507a58e1308c/users/b8d48da2258d4de8958746c92a99d00f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:32.942340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73098f3-f845-42ea-be63-76878b1d543e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:32.942637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73098f3-f845-42ea-be63-76878b1d543e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:32.942920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73098f3-f845-42ea-be63-76878b1d543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:32.977278 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d73098f3-f845-42ea-be63-76878b1d543e None None] MFA Rules not processed for user `b8d48da2258d4de8958746c92a99d00f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:32.978543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d73098f3-f845-42ea-be63-76878b1d543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:33.045847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1172/2310] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:33.057996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:33.060091 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:33.120663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45cc7-aa73-4ddf-baf0-27435bf2f0d8 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:33.124227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:33.124875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:33.125158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:33.125435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:33.134469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:33.135927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:33.145664 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1139/2311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:38.102514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda735-ef4c-490c-9941-622311033dcf None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:38.103017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda735-ef4c-490c-9941-622311033dcf None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:38.103235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda735-ef4c-490c-9941-622311033dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:38.139491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-84dda735-ef4c-490c-9941-622311033dcf None None] MFA Rules not processed for user `268380d74d1846798174e7c3539dcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:38.141606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-84dda735-ef4c-490c-9941-622311033dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:38.181028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:38.208825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1173/2312] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:43.140804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:43.484099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:43.545648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a294-f0cf-4577-aa2e-9ef035bf38e4 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:43.550116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:43.550984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:43.551320 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:43.551596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] PATH_INFO: `/v3/users/b8d48da2258d4de8958746c92a99d00f` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:43.553374 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d48da2258d4de8958746c92a99d00f)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:43.555347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:43.602336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d48da2258d4de8958746c92a99d00f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:43.603422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d48da2258d4de8958746c92a99d00f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:43.614551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d48da2258d4de8958746c92a99d00f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:43.622790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d48da2258d4de8958746c92a99d00f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:43.636452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d48da2258d4de8958746c92a99d00f'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:43.642742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1140/2313] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:43 2022] DELETE /identity/v3/users/b8d48da2258d4de8958746c92a99d00f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:43.647881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:43.648357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:43.648459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:43.667402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:43.668615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:43.733590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1174/2314] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:43.743674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:43.745275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:43.812506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9b0e-4a54-487f-bbdf-8c2f1f15b346 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:43.816967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:43.817724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:43.818012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:43.818450 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:43.829094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:43.830683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5a5c4-2a35-4c80-8145-5517cbfd436d service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:43.841829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1141/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:44.406111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.407826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:44.425381 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822891-a6b6-4cd2-8172-5c7c6fa0379d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.432190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.433103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.433328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.433599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] PATH_INFO: `/v3/projects/4761b86859554c3984b4507a58e1308c` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.434872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4761b86859554c3984b4507a58e1308c)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.436708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.484880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4761b86859554c3984b4507a58e1308c', 'request_id': 'req-a2ca086d-59c2-44d6-946a-a9267335465c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:44.492174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4761b86859554c3984b4507a58e1308c', 'request_id': 'req-a2ca086d-59c2-44d6-946a-a9267335465c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:44.497687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4761b86859554c3984b4507a58e1308c', 'request_id': 'req-a2ca086d-59c2-44d6-946a-a9267335465c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:44.508501 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] The token cache is being invalidate because project 4761b86859554c3984b4507a58e1308c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:44.508780 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:44.509403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2ca086d-59c2-44d6-946a-a9267335465c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:44.510939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1175/2316] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:44 2022] DELETE /identity/v3/projects/4761b86859554c3984b4507a58e1308c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:44.517329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.517835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.518093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.538354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:44.539613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:44.557128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:44.600281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1142/2317] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:44.608349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.608641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.608928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.627486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:44.628684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:44.637370 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1176/2318] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:44.642616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.652507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e985d4-1f5c-4aaa-b07d-86912feb1b4a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.657037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.657709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.658029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.658314 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.659064 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:44.659297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.660898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.676234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1143/2319] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:44.677362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.688024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf702-0ce8-4c96-8c1c-7de2c2c95fd8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.693972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.694656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.694938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.695248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.695943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.697872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.724015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1177/2320] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:47:44.729049 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.739636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65179b9f-eaef-4578-90d3-7a8015a7668e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.801423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.802131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.802416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.803339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.804041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.805996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.829310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1144/2321] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:44 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:47:44.830489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.841186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12c842-915e-4f43-965b-cc3d207dab0e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.845846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.846520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.846807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.847102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.847879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.850135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.861544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1178/2322] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:44.865976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.876202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a4074-0f73-4b32-a7f4-a3a186f6f58e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.881101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.881892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.882171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.882447 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.883196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.884930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef560-88cb-4d77-a033-7fdc8aa38ae7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.898074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1145/2323] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:44.902011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:44.917557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ebf3d-a61c-483d-9afb-9b685107c405 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:44.922968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:44.924113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.924442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.924727 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] PATH_INFO: `/v3/projects/a2dfdde6f5f04373837b84353f5697d6/users/ede6a0e1333e46f58a32fdff3f6abab0/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:44.941541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dfdde6f5f04373837b84353f5697d6, user_id=ede6a0e1333e46f58a32fdff3f6abab0, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:44.944895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:44.965357 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1179/2324] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:44 2022] PUT /identity/v3/projects/a2dfdde6f5f04373837b84353f5697d6/users/ede6a0e1333e46f58a32fdff3f6abab0/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:44.972021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323bc86-7a2e-4a0f-9657-14c61a3622d2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:44.972477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323bc86-7a2e-4a0f-9657-14c61a3622d2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:44.972759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323bc86-7a2e-4a0f-9657-14c61a3622d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:45.008874 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2323bc86-7a2e-4a0f-9657-14c61a3622d2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:45.010219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2323bc86-7a2e-4a0f-9657-14c61a3622d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:45.081206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1146/2325] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:45.091457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:45.093358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:45.100528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:45.158060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843b3de-ccc8-4edd-a83c-d22e707df638 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:45.162731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:45.163534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:45.163978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:45.164281 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:45.173798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:45.175219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:45.185224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1180/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:49.445431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.446028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.446028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.487297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] MFA Rules not processed for user `ede6a0e1333e46f58a32fdff3f6abab0`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:49.488633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:49.510634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:49.567048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1147/2327] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:49.572268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.582171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0158fd-0b92-4e1f-809c-f7532a84b78b service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.587803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.588662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.588942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.589218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.589938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.591887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:49.619220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1181/2328] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:49 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:49.623355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.635892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becba91-163d-440d-bde3-9b86a2617806 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.695731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.696589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.696906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.697182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.697887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.700062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:49.721902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1148/2329] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:49 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:49.726260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.743249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c6bb-1d59-4c7a-93ad-93bbb23f1ed2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.755606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.757033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.757448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.757786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.758555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.760283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:49.773681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1182/2330] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:49.778201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.790809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff32a17-cffa-4281-9462-25f678d98043 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.797194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.798196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.798539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.798885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] PATH_INFO: `/v3/projects/a318c2e884a146af9e81bc00596dcd77/users/416b7f6b34304cacba32ba4b1060c7a2/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.818731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a318c2e884a146af9e81bc00596dcd77, user_id=416b7f6b34304cacba32ba4b1060c7a2, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.821634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:49.838633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1149/2331] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:49 2022] PUT /identity/v3/projects/a318c2e884a146af9e81bc00596dcd77/users/416b7f6b34304cacba32ba4b1060c7a2/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:49.839928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.852031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb70d2-937b-4a64-9473-33bc4f673f37 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.918250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.918940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.919260 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.919680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.925180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.927009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:49.951286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1183/2332] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:47:49.955378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:49.972075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7aa1-c32f-46e9-91b5-074b2129893b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:49.977524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:49.978409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:49.978688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:49.978957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] PATH_INFO: `/v3/projects/a318c2e884a146af9e81bc00596dcd77/users/416b7f6b34304cacba32ba4b1060c7a2/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:49.981119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a318c2e884a146af9e81bc00596dcd77, user_id=416b7f6b34304cacba32ba4b1060c7a2, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:49.984259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ce3b0-8e18-4392-98a1-33e932cc8e23 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:50.005676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1150/2333] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:49 2022] PUT /identity/v3/projects/a318c2e884a146af9e81bc00596dcd77/users/416b7f6b34304cacba32ba4b1060c7a2/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:47:52.376334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:52.377903 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:52.397554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd019b3-fa01-49b9-9553-7c941e0f5875 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:52.467891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:52.468794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:52.469088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:52.469364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] PATH_INFO: `/v3/users/da0f8e1ea3f447428171f15f8fdc992d` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:52.471893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0f8e1ea3f447428171f15f8fdc992d)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:52.473862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:52.491870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:52.535433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0f8e1ea3f447428171f15f8fdc992d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:52.546379 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0f8e1ea3f447428171f15f8fdc992d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:52.569530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0f8e1ea3f447428171f15f8fdc992d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:52.570280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0f8e1ea3f447428171f15f8fdc992d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:52.580305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0f8e1ea3f447428171f15f8fdc992d'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:52.590992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1184/2334] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:52 2022] DELETE /identity/v3/users/da0f8e1ea3f447428171f15f8fdc992d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:52.593021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:52.593528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:52.593608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:52.615634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:52.617137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:52.691605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1151/2335] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:52.702184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:52.703803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:52.792551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348731a1-89ed-4a25-962e-a3d8bc654dbb admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:52.796289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:52.797109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:52.797401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:52.797748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:52.822161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:52.837690 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102ef3-b593-4cc2-806d-c4c67023382f service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:52.860493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1185/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:54.117918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:54.119914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:54.138841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8a36-606e-4c27-afec-613083f089f1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:54.167982 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:54.168892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:54.169191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:54.169473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] PATH_INFO: `/v3/projects/a8680f6d26dd4f3d8e4167a5d7ffeb55` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:54.180388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8680f6d26dd4f3d8e4167a5d7ffeb55)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:54.182300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:54.189967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:54.288642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8680f6d26dd4f3d8e4167a5d7ffeb55', 'request_id': 'req-ad44140c-303b-4cf7-a53c-f0a96d52e363'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:54.325219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8680f6d26dd4f3d8e4167a5d7ffeb55', 'request_id': 'req-ad44140c-303b-4cf7-a53c-f0a96d52e363'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:54.352550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8680f6d26dd4f3d8e4167a5d7ffeb55', 'request_id': 'req-ad44140c-303b-4cf7-a53c-f0a96d52e363'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:54.384239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] The token cache is being invalidate because project a8680f6d26dd4f3d8e4167a5d7ffeb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:54.384540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:54.385261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-ad44140c-303b-4cf7-a53c-f0a96d52e363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:54.386878 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1152/2337] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:54 2022] DELETE /identity/v3/projects/a8680f6d26dd4f3d8e4167a5d7ffeb55 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:54.392188 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:54.394380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:54.394890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:54.432443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:54.433693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:54.543636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1186/2338] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:54.554000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:54.554309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:54.554572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:54.581573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:54.583497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:54.595083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1153/2339] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:54.601419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:54.639399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5780e-19e5-4c6c-b9f8-dd6f26e84de5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:54.651322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:54.652029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:54.652318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:54.652600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:54.653550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:54.653865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:54.655552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:54.672252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1187/2340] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:54.676579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:54.695009 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475533c3-d4d0-426d-9115-a25b90af0db7 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:54.733590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:54.739995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:54.740287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:54.740553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:54.741295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:54.743267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:54.822283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1154/2341] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:54.823514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:54.835766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430a172-294c-4ada-9f53-2b6ac1095465 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:54.875593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:55.011874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.012566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.012900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.013184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.013884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.015867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.068354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1188/2342] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:54 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:55.072650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:55.087877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5fe9-85ee-41ed-9669-cdf989917987 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:55.111829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.112781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.113218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.113675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.114766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.117409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.135295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1155/2343] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:55.136952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:55.158017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6940-83dd-4400-a8b5-2d6f4ce7c7d4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:55.165178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.166414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.166933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.167525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.168508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.170522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f5bb-9669-4ab9-a931-9fdb5de6e874 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.201466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:55.202385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1189/2344] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:55.214528 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d693-ba85-421d-9417-5d2bd49a4038 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:55.220135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.231253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.232253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.232814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] PATH_INFO: `/v3/projects/39e87974c3714ddeb12998ec846df66d/users/4d1a801cf07a42a68a39af6a7778fa32/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.254508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e87974c3714ddeb12998ec846df66d, user_id=4d1a801cf07a42a68a39af6a7778fa32, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.258602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.291792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1156/2345] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:55 2022] PUT /identity/v3/projects/39e87974c3714ddeb12998ec846df66d/users/4d1a801cf07a42a68a39af6a7778fa32/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:55.293266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.294723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.300425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.368122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] MFA Rules not processed for user `4d1a801cf07a42a68a39af6a7778fa32`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:55.370716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:55.577183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1190/2346] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:55.589822 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:55.591924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:55.688093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d159-c530-431a-a18a-2ef78028a173 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:55.692900 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.694258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.694679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.695165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.706540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.708715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfd495-5f47-4d15-8ac8-75f5ab8de50b service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.720770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1157/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:55.748524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:55.849530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb1b9-9303-4966-8a13-2ebf8030d1e1 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:55.860279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:55.861367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:55.861757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:55.862584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] PATH_INFO: `/v3/users/4d1a801cf07a42a68a39af6a7778fa32` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:55.864409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1a801cf07a42a68a39af6a7778fa32)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:55.869873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:55.930906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:55.961394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1a801cf07a42a68a39af6a7778fa32'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:55.973557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1a801cf07a42a68a39af6a7778fa32'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.000561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1a801cf07a42a68a39af6a7778fa32'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.007446 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1a801cf07a42a68a39af6a7778fa32'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.016698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1a801cf07a42a68a39af6a7778fa32'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.031459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d068-e188-4b60-b081-b6001814d08e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.032211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d068-e188-4b60-b081-b6001814d08e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.033358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d068-e188-4b60-b081-b6001814d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.035436 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1191/2348] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:47:55 2022] DELETE /identity/v3/users/4d1a801cf07a42a68a39af6a7778fa32 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:56.060216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-dcd0d068-e188-4b60-b081-b6001814d08e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:56.061887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-dcd0d068-e188-4b60-b081-b6001814d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.155506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:56.227781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1158/2349] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:56.242936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:56.244439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.328697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5530d5-9a29-463f-952d-f10264d2b493 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:56.340954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:56.341353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.341640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.341918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.363176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:56.366057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:56.378517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1192/2350] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:56.454800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.455599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.456057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.502559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] MFA Rules not processed for user `416b7f6b34304cacba32ba4b1060c7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:56.504243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.614504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1159/2351] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:56.623324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:56.625827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.722012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060de896-99de-41e6-b77c-662ef5008848 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:56.726368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:56.727030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.727340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.727620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.729439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.783651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:56.787355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:56.812292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a442c-e0c0-4058-a985-dc6da0c0cc1f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:56.821433 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:56.822285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.822569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.822951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] PATH_INFO: `/v3/projects/39e87974c3714ddeb12998ec846df66d` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.824752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e87974c3714ddeb12998ec846df66d)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:56.827307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:56.836421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:56.838045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a5661-1bd6-476d-bf7b-c76fb23b8bcc service glance] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:56.853109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1193/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:56.910513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e87974c3714ddeb12998ec846df66d', 'request_id': 'req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.918898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e87974c3714ddeb12998ec846df66d', 'request_id': 'req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.930728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e87974c3714ddeb12998ec846df66d', 'request_id': 'req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.952364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] The token cache is being invalidate because project 39e87974c3714ddeb12998ec846df66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:47:56.952798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.953535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-0a2bb9d0-9f61-4a02-966d-cfabce65c7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:47:56.955617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1160/2353] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:47:56 2022] DELETE /identity/v3/projects/39e87974c3714ddeb12998ec846df66d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:56.960449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2a48-8ae0-4bcd-84af-db6255ac9e53 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:56.961028 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2a48-8ae0-4bcd-84af-db6255ac9e53 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:56.961416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2a48-8ae0-4bcd-84af-db6255ac9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:56.972705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:56.987825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-29fc2a48-8ae0-4bcd-84af-db6255ac9e53 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:56.989564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-29fc2a48-8ae0-4bcd-84af-db6255ac9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.001155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.002133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.002529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.022755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:57.024021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.069778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:57.071179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1194/2354] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:57.079125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.079443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.079725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.095668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1161/2355] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:57.101971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:57.103598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.111696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.113086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.118079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1195/2356] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:47:57.119099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.129667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c7ce-6468-43fb-9dfa-be8e57d491dd None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.135148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.135917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.136267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.136762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.137573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:47:57.137948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.139740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.158002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1196/2357] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:47:57.159004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.170291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c7c03-64a8-438d-b76e-3e82c4a2fa50 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.175475 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.176150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.176426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.176704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.178124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.180129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.191481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e45db-4069-4173-bc6d-d426d508a0ae None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.198906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.199630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.199966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.200249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.209921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1197/2358] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:47:57 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:57.213349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.213603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.214380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.223080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1162/2359] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:47:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:47:57.309152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d3e8d-833c-4e78-81f7-f9907da4f5ad admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.313957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.314640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.314936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.315548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.316248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.318969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.384399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1198/2360] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:47:57 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:47:57.388338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.407864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f70e9-61ae-4026-9e2a-bab8afb14f07 service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.413597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.414407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.414785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.415178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.416788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.418092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.432818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1163/2361] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:57.433530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.476628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5685fad-74f5-4c98-bccf-3ae1ca329625 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.489282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.490479 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.490874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.491288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.492116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.493781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71b3d0-e8f1-4759-9377-6077b48936d5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.521647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1199/2362] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:47:57.522953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.538020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86de90-c2c3-4f9b-82b0-aefa6f481062 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.545013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.546055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.547056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.547466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] PATH_INFO: `/v3/projects/1a3b96be88db4dd4b17172ff1ca55a0a/users/f848993998124f8bbd1e158c3039d76c/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.576728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3b96be88db4dd4b17172ff1ca55a0a, user_id=f848993998124f8bbd1e158c3039d76c, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.580268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.603250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1164/2363] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:47:57 2022] PUT /identity/v3/projects/1a3b96be88db4dd4b17172ff1ca55a0a/users/f848993998124f8bbd1e158c3039d76c/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:47:57.608257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53a9d-1bc1-4709-86a4-eaff87214a9f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.608808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53a9d-1bc1-4709-86a4-eaff87214a9f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.609258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e53a9d-1bc1-4709-86a4-eaff87214a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.656639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-65e53a9d-1bc1-4709-86a4-eaff87214a9f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:57.658983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-65e53a9d-1bc1-4709-86a4-eaff87214a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.737629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:57.771782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1200/2364] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:57.780157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:57.782654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:57.886991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8490c8-5fc6-4b75-b5ad-9f925edcf4de admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:57.894355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:57.895078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:57.895370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:57.895648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:57.908336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:57.911582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:57.923836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1165/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:47:58.890750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a75fa-10e2-4486-ba09-b6d8794f40c1 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:58.891348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a75fa-10e2-4486-ba09-b6d8794f40c1 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:58.891348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a75fa-10e2-4486-ba09-b6d8794f40c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:58.940433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-190a75fa-10e2-4486-ba09-b6d8794f40c1 None None] MFA Rules not processed for user `f848993998124f8bbd1e158c3039d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:47:58.941672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-190a75fa-10e2-4486-ba09-b6d8794f40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:59.055323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1201/2366] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:47:59.057369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:47:59.058907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:47:59.118723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:47:59.132991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c291e-f4eb-43dd-9528-424937e6e0d2 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:47:59.137214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:47:59.137997 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:47:59.138384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:47:59.138766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:47:59.150171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:47:59.152192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e80b80-1693-488f-a299-5c8ef29af0ee service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:47:59.176795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1166/2367] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:47:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:00.611349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1fc87-5509-4b2c-a950-59277cda1c9a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:00.611961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1fc87-5509-4b2c-a950-59277cda1c9a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:00.611961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1fc87-5509-4b2c-a950-59277cda1c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:00.631811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-27f1fc87-5509-4b2c-a950-59277cda1c9a None None] MFA Rules not processed for user `f848993998124f8bbd1e158c3039d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:00.633294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-27f1fc87-5509-4b2c-a950-59277cda1c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:00.640199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1202/2368] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:07.729941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:07.730472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:07.730472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:07.748618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] MFA Rules not processed for user `ede6a0e1333e46f58a32fdff3f6abab0`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:07.749799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:07.804623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1167/2369] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:48:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:09.697614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6615-74fa-4982-8e74-c501c32ef84f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:09.698170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6615-74fa-4982-8e74-c501c32ef84f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:09.698263 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb6615-74fa-4982-8e74-c501c32ef84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:09.716801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-7ecb6615-74fa-4982-8e74-c501c32ef84f None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:09.718149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7ecb6615-74fa-4982-8e74-c501c32ef84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:09.781611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1203/2370] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:48:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:09.804238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:09.877579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbc57d-a9ff-48a9-a721-cafe88467753 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:09.883693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:09.884423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:09.884710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:09.884989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:09.897241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:09.898860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:09.907883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1168/2371] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:48:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:48:19.774182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=68 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:19.904078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=63 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:23.348750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:23.350194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:23.350652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:23.377857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:23.379395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:23.400414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1204/2372] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:23.418055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:23.435840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1315-7921-42cd-a750-9e8e5d4632e2 service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:23.442639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:23.444712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:23.445043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:23.445324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:23.461041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:23.463246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:23.473281 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1169/2373] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:48:31.828061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:31.834670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:31.981409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2314a8-a60d-4967-89b8-8cbdb4e3a486 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:31.997269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:31.998014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:31.998350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:31.998598 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:32.000530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:32.014682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:32.016378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737ca9-a121-4df2-bd9d-a981b6dc84db service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:32.046430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1205/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:33.468944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=6 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:35.703760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:35.713585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d83b3-5686-4fd0-aeeb-d5f95cbf8402 service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:35.717096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:35.717757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:35.718033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:35.718302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:35.720118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:35.781918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:35.783490 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7129f-3cf6-43f6-a972-0cef15523847 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:35.792893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1170/2375] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:39.767592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:39.768681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:39.769116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:39.770934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1206/2376] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:48:39.793330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58c8b-7c87-4f2c-9ddd-bafa404b8de0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:39.793989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58c8b-7c87-4f2c-9ddd-bafa404b8de0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:39.793989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58c8b-7c87-4f2c-9ddd-bafa404b8de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:39.815732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-deb58c8b-7c87-4f2c-9ddd-bafa404b8de0 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:39.817305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-deb58c8b-7c87-4f2c-9ddd-bafa404b8de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:39.915209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1171/2377] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:48:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:39.934324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:39.936090 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:40.018146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66b15-f8da-4067-a7ad-fcec12dbde10 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:40.022347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:40.023520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.024639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.025108 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.037184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:40.038767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8498b7-5b6e-4256-86af-1615443c4da9 service glance] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:40.054824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1207/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:40.128010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.128351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.128817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.130473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1172/2379] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:48:40.136929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843937-e9e9-4a2a-8002-53e18a29aa06 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.137456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843937-e9e9-4a2a-8002-53e18a29aa06 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.137911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843937-e9e9-4a2a-8002-53e18a29aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.158678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-05843937-e9e9-4a2a-8002-53e18a29aa06 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:40.159981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-05843937-e9e9-4a2a-8002-53e18a29aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:40.167633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1208/2380] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:48:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:40.179957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:40.181727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:40.195598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489b714-eae4-4899-a8ab-20d1ede76ce6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:40.199224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:40.200084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.200366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.200642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.207883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:40.209297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5189419-41db-4e17-a45e-335829d3cb03 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:40.217846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1173/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:40.328936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c33f-afba-45de-b490-ed50649d85ab None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.329220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c33f-afba-45de-b490-ed50649d85ab None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.329447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c33f-afba-45de-b490-ed50649d85ab None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.330961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1209/2382] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:48:40.355209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e83c5-49bf-4a1c-a38b-0127f9d70f0d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.355209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e83c5-49bf-4a1c-a38b-0127f9d70f0d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.355598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e83c5-49bf-4a1c-a38b-0127f9d70f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.389885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-0c0e83c5-49bf-4a1c-a38b-0127f9d70f0d None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:40.391224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0c0e83c5-49bf-4a1c-a38b-0127f9d70f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:40.413971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1174/2383] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:48:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:40.426853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c33f-afba-45de-b490-ed50649d85ab None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:40.440070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c33f-afba-45de-b490-ed50649d85ab None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:40.443801 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:40.445046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:40.445477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:40.445765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:40.457840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:40.460687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:40.487386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1210/2384] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:41.948569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea2c5-338b-4cb7-bc49-97d6762ace75 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:41.949135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea2c5-338b-4cb7-bc49-97d6762ace75 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:41.949135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea2c5-338b-4cb7-bc49-97d6762ace75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:41.966722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-de6ea2c5-338b-4cb7-bc49-97d6762ace75 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:41.967944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-de6ea2c5-338b-4cb7-bc49-97d6762ace75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:41.975850 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1175/2385] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:42.001922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:42.003321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:42.018626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf882-fe9c-4d9f-bfb4-907a11c18691 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:42.026282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:42.026927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:42.027254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:42.027514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:42.036484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:42.038081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00486e4-2fd7-4449-83b5-047717bd6620 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:42.048703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1211/2386] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:48:44.793382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:44.793894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:44.793979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:44.820068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:44.821642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:44.833636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1176/2387] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:44.838316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:44.838788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:44.838990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:44.847336 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:44.848890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:44.859385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:44.860889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:44.866594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210393e-8148-44e2-8e50-73e24a6ad41c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:44.870533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1212/2388] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:44.873202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:44.873858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:44.874258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:44.874544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:44.883031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:44.883729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:44.885339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0d7f8-4f2c-42d7-8c9d-5af84b9e1395 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:44.894969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1177/2389] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:48:44.895307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1a639-fd47-477c-8f5c-5c33436ecc7f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:44.900552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:44.901202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:44.901486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:44.901764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:44.910176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:44.911788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:44.920646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1213/2390] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:48:54.890601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=82 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:54.917322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=85 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:48:59.354755 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a268a-9aa7-4932-b4d9-4f1c6c6f5bd7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:59.355249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a268a-9aa7-4932-b4d9-4f1c6c6f5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:59.355611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a268a-9aa7-4932-b4d9-4f1c6c6f5bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:59.375324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-388a268a-9aa7-4932-b4d9-4f1c6c6f5bd7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:48:59.376698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-388a268a-9aa7-4932-b4d9-4f1c6c6f5bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:48:59.384804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1178/2391] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:48:59.400442 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:48:59.412224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab7cd-8343-4ceb-9064-20a2628f60fa service swift] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:48:59.418614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:48:59.419288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:48:59.419571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:48:59.419869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:48:59.428812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:48:59.430504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:48:59.440867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1214/2392] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:02.433035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a39-847f-4c03-9730-2898ea5c6d76 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:02.433722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a39-847f-4c03-9730-2898ea5c6d76 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:02.433722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19a39-847f-4c03-9730-2898ea5c6d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:02.452540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-22f19a39-847f-4c03-9730-2898ea5c6d76 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:02.453746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-22f19a39-847f-4c03-9730-2898ea5c6d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:02.461775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1179/2393] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:02.476116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:02.487836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5584-7f90-4f66-bee7-9f17b51ac167 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:02.493934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:02.494581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:02.494864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:02.495182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:02.504286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:02.505874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:02.516457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1215/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:06.033254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d675ef-40d5-4e07-8f11-1c97157c7c8e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:06.033718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d675ef-40d5-4e07-8f11-1c97157c7c8e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:06.033980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d675ef-40d5-4e07-8f11-1c97157c7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:06.052063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-09d675ef-40d5-4e07-8f11-1c97157c7c8e None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:06.053359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-09d675ef-40d5-4e07-8f11-1c97157c7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:06.062193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1180/2395] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:06.076273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:06.088611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eb14-7393-4806-9c30-097898f1a73c service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:06.106476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:06.107684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:06.108149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:06.108425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:06.120211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:06.121832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:06.130939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1216/2396] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:49:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:49:06.635818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6089-46f7-4523-94fa-5953676ebc36 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:06.636111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6089-46f7-4523-94fa-5953676ebc36 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:06.636394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a6089-46f7-4523-94fa-5953676ebc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:06.654745 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d77a6089-46f7-4523-94fa-5953676ebc36 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:06.655976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d77a6089-46f7-4523-94fa-5953676ebc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:06.663821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1181/2397] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:06.681419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:06.693241 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8213e-903d-49c3-8113-cd076505eb0c service swift] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:06.699341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:06.699971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:06.700255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:06.700531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:06.708715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:06.710374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4352897-3ebb-46f4-89b2-ebeb0249092f service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:06.720764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1217/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:07.000245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:07.000534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:07.000814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:07.018614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] MFA Rules not processed for user `268380d74d1846798174e7c3539dcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:07.019845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:07.075089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1182/2399] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:10.823915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed90-6091-42fe-9125-7c912d44bd31 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:10.824385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed90-6091-42fe-9125-7c912d44bd31 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:10.824477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed90-6091-42fe-9125-7c912d44bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:10.842688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-6f9bed90-6091-42fe-9125-7c912d44bd31 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:10.843927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-6f9bed90-6091-42fe-9125-7c912d44bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:10.852122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1218/2400] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:10.868238 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:10.881258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17887c7-8c9c-4444-a069-4dfbf258a7bc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:10.887708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:10.888362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:10.888649 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:10.888930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:10.897698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:10.899389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a754d-84b0-4439-a3db-442d7f888b82 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:10.909986 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1183/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:20.837383 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=27 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:20.905549 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=43 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:27.101930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:27.102451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:27.102561 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:27.126068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] MFA Rules not processed for user `f848993998124f8bbd1e158c3039d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:27.127302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:27.134255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1219/2402] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:49:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:37.120403 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:40.943642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d62b7-f8e2-409d-8b3c-e5902488c2f0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:40.944178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d62b7-f8e2-409d-8b3c-e5902488c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:40.944178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d62b7-f8e2-409d-8b3c-e5902488c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:40.961628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d88d62b7-f8e2-409d-8b3c-e5902488c2f0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:40.962811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d88d62b7-f8e2-409d-8b3c-e5902488c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:40.970839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1184/2403] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:40.985386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:40.998632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5756e-b6f0-4811-bde1-93526cd1fc31 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:41.004079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:41.004720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:41.005004 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:41.005283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:41.013665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:41.015282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:41.024712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1220/2404] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:44.195188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acabb-db9a-4992-a8f0-e04c9bf49d86 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:44.196055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acabb-db9a-4992-a8f0-e04c9bf49d86 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:44.196363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acabb-db9a-4992-a8f0-e04c9bf49d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:44.215520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c84acabb-db9a-4992-a8f0-e04c9bf49d86 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:44.216638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c84acabb-db9a-4992-a8f0-e04c9bf49d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:44.225141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1185/2405] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:44.239918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:44.252423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd46d6-ffca-4318-bd2e-463a17f228f3 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:44.258313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:44.259225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:44.259499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:44.259784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:44.269674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:44.271294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:44.283923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1221/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:50.422799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4818c5-752d-43d3-aa18-ccd9f7a66bc6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.424210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4818c5-752d-43d3-aa18-ccd9f7a66bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.424914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4818c5-752d-43d3-aa18-ccd9f7a66bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.452056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9d4818c5-752d-43d3-aa18-ccd9f7a66bc6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:50.453488 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9d4818c5-752d-43d3-aa18-ccd9f7a66bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:50.462539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1186/2407] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:50.488238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:50.501021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85317eb-add8-4b24-97c1-623867900b97 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.508868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.509619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.509963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.510302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.519922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.521595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f68ca-81f5-4635-be9a-5d12a6783228 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.532111 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1222/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:49:54.641798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:54.648519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:54.649157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:54.652908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:54.653375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:54.653518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:54.686034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:54.689062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:54.689758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] MFA Rules not processed for user `b755c5dbee064673b16b29466f308e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:54.691201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:54.700434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1187/2409] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:54.717498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:54.735404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961a55b-be11-4bd1-a0cd-1728dbae1a83 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:54.744521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:54.746118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:54.746683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:54.747287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:54.757533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:54.759390 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da029e-209e-467b-9ba2-f5949e701153 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:54.777268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1188/2410] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:49:54.793752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1223/2411] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:49:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:57.820328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486788-b792-49a1-bb3c-071ca28d8821 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.820880 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486788-b792-49a1-bb3c-071ca28d8821 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.820973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48486788-b792-49a1-bb3c-071ca28d8821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.840362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-48486788-b792-49a1-bb3c-071ca28d8821 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:57.841588 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-48486788-b792-49a1-bb3c-071ca28d8821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:57.849788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1189/2412] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Jul 25 05:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:49:57.865282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.884779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88d971-c84d-4666-9b35-bca233909efa None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.893151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.894225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.894777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.895074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.905875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.907513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.933805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1224/2413] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:49:59.065015 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:59.065574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:59.065574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:59.083269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] MFA Rules not processed for user `9a671fbfa3374b288551871a4f4198d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:59.084462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:59.139188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1190/2414] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:49:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:07.913895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=49 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.132377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=46 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.914025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.915633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:26.929315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d47d1-9d82-4fbc-9961-70df908a83ae service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.934074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.934945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.935268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.935546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] PATH_INFO: `/v3/users/268380d74d1846798174e7c3539dcb1f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.936744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268380d74d1846798174e7c3539dcb1f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.938663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.985923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268380d74d1846798174e7c3539dcb1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:26.993387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268380d74d1846798174e7c3539dcb1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.005358 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268380d74d1846798174e7c3539dcb1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.006017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268380d74d1846798174e7c3539dcb1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.013075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268380d74d1846798174e7c3539dcb1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.019073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1225/2415] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:26 2022] DELETE /identity/v3/users/268380d74d1846798174e7c3539dcb1f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:27.029257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.038807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6c46a-1036-462d-b3fb-c097a9f6f18b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.086445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.087144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.087436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.088222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.090058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:27.154475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.155940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d0c2e-a240-4075-8879-e4866e95224e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.165512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1191/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:27.332367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.334036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:27.349647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdeaa5-89f2-4a41-9a34-515be7802523 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.354939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.356225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.356513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.357882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] PATH_INFO: `/v3/projects/71a39d9cebe34c86b7cf6899f4cb483a` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.359468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a39d9cebe34c86b7cf6899f4cb483a)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.361464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.535614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a39d9cebe34c86b7cf6899f4cb483a', 'request_id': 'req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.544315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a39d9cebe34c86b7cf6899f4cb483a', 'request_id': 'req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.554191 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a39d9cebe34c86b7cf6899f4cb483a', 'request_id': 'req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.566216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] The token cache is being invalidate because project 71a39d9cebe34c86b7cf6899f4cb483a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:27.566517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.567345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0e3b84b3-3c04-4a64-a7db-cda8eb6558bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:27.568933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1226/2417] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:27 2022] DELETE /identity/v3/projects/71a39d9cebe34c86b7cf6899f4cb483a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:27.575481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.575711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.575990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.593937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:27.595124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:27.653757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1192/2418] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:50:27.661645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912051b-2465-416b-85a2-8d424a837990 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.661925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912051b-2465-416b-85a2-8d424a837990 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.662197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912051b-2465-416b-85a2-8d424a837990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.679696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c912051b-2465-416b-85a2-8d424a837990 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:27.680889 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c912051b-2465-416b-85a2-8d424a837990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:27.689476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1227/2419] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:27.693848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.704268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60e0ca-e9f7-44d6-9d69-a9a2b2b53868 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.708922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.709580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.709868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.710147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.710877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:27.711225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.712846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.725207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1193/2420] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:27.729803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912051b-2465-416b-85a2-8d424a837990 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.739288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912051b-2465-416b-85a2-8d424a837990 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.743893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.745055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.745336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.745613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.746299 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.748227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.773210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1228/2421] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:27.777684 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.787753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200e797-e991-4de1-a03b-1b7340f32872 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.820897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:27.844810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.845412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.845696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.845977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.846663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.848612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.868635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1194/2422] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:27 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:27.873227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.883772 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac6a1b-d300-4cc1-92a1-8779c721cf8f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.889044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.889691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.890024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.890295 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.891010 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.892672 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.902984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1229/2423] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:27.906989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.917290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe70880-bb72-4a6d-9e3c-f172b5fd9839 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.921929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.922579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.922863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.923191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.923915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.925504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0ced-167e-43b2-8c1c-2ba15e23ba08 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.936275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1195/2424] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:27.940203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.950882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be050-15c5-4a46-92fe-40fe507fc220 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.955542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.956413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.956695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.956972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] PATH_INFO: `/v3/projects/a14132bb3d644bce9ffd189c748313b2/users/094658abc3de483ab931881aa71ae2a7/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.968608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:27.972049 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14132bb3d644bce9ffd189c748313b2, user_id=094658abc3de483ab931881aa71ae2a7, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.975343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.988698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1230/2425] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:27 2022] PUT /identity/v3/projects/a14132bb3d644bce9ffd189c748313b2/users/094658abc3de483ab931881aa71ae2a7/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:28.000072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.000361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.000655 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.027265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] MFA Rules not processed for user `094658abc3de483ab931881aa71ae2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:28.028468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:28.093618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1196/2426] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:28.098146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.159461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159c15-abb3-4f86-b398-022902818594 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.164030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.164680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.164958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.165229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.166416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.168329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.194607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1231/2427] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:28.204016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.215253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71afa2-4e79-4736-be14-21f6c7c2a6dc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.271813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.272487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.272773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.273063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.273748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.275761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.295624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1197/2428] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:28.299630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.310582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1cdec-277b-4021-85ad-c91790a9331c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.315175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.315838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.316119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.316397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.317149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.318920 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.329201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1232/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:28.333117 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.343218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f34fb2-9424-437a-8ac8-1a7dd7c63380 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.347894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.349337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.349337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.349337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] PATH_INFO: `/v3/projects/443a4259393c40f9a7e23b198aa5b11e/users/c0c43fe2819d4fe3a75be6ae8f053230/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.365389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443a4259393c40f9a7e23b198aa5b11e, user_id=c0c43fe2819d4fe3a75be6ae8f053230, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.368135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.381963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1198/2430] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:28 2022] PUT /identity/v3/projects/443a4259393c40f9a7e23b198aa5b11e/users/c0c43fe2819d4fe3a75be6ae8f053230/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:28.386112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.396114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa75d7-6c5a-4538-a980-6c988b14ed0e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.451741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.452402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.452680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.452952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.453664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.455310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3c4ce-3287-484c-a0fc-652a0557208e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.465509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1233/2431] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:28.469735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.480954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd372d-b7be-42f6-8e8f-6db9231644f8 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.485808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.486682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.486959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.487258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] PATH_INFO: `/v3/projects/443a4259393c40f9a7e23b198aa5b11e/users/c0c43fe2819d4fe3a75be6ae8f053230/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.489199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443a4259393c40f9a7e23b198aa5b11e, user_id=c0c43fe2819d4fe3a75be6ae8f053230, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.491851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.497697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:28.503172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1199/2432] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:28 2022] PUT /identity/v3/projects/443a4259393c40f9a7e23b198aa5b11e/users/c0c43fe2819d4fe3a75be6ae8f053230/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:28.513176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.513464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.513743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.539781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] MFA Rules not processed for user `c0c43fe2819d4fe3a75be6ae8f053230`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:28.541592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:28.587336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:28.611737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1234/2433] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:28.624538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.626922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:28.688723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7887e-adad-409a-8a2f-6b64c9908d55 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.692389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.693334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.693463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.693635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.704756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.706187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.716201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1200/2434] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:29.023034 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.033212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f310-5016-440f-bdec-4a9ea700075a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.037872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0c43fe2819d4fe3a75be6ae8f053230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '443a4259393c40f9a7e23b198aa5b11e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.038619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.038977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.039346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.040132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:29.040502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.042490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.054075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1235/2435] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:29.058538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.067621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0832cd-c33d-49fa-b7b9-219a372a17b3 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.073114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0c43fe2819d4fe3a75be6ae8f053230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '443a4259393c40f9a7e23b198aa5b11e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.073891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.074179 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.074458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.075157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.077076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.105288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1201/2436] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:29 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:29.110057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.121136 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208056d-766d-4ad7-8ab7-4ae75e4990d0 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.180048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0c43fe2819d4fe3a75be6ae8f053230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '443a4259393c40f9a7e23b198aa5b11e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.180715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.180999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.181948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.182655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:29.182958 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.184605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.196371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1236/2437] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:29.232265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.242751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3ba5-d56e-49be-a703-271b43043d55 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.248348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0c43fe2819d4fe3a75be6ae8f053230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '443a4259393c40f9a7e23b198aa5b11e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.249289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.249642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.249989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] PATH_INFO: `/v3/projects/3d256c7903aa4e7bac7693e264312039` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.251275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d256c7903aa4e7bac7693e264312039)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.253304 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.301847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d256c7903aa4e7bac7693e264312039', 'request_id': 'req-c01dfdf1-ff50-46f6-b895-ee372b6d0838'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.308537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d256c7903aa4e7bac7693e264312039', 'request_id': 'req-c01dfdf1-ff50-46f6-b895-ee372b6d0838'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.315886 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d256c7903aa4e7bac7693e264312039', 'request_id': 'req-c01dfdf1-ff50-46f6-b895-ee372b6d0838'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.327842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] The token cache is being invalidate because project 3d256c7903aa4e7bac7693e264312039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:29.328263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.328922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-c01dfdf1-ff50-46f6-b895-ee372b6d0838 tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.330494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1202/2438] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:29 2022] DELETE /identity/v3/projects/3d256c7903aa4e7bac7693e264312039 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:29.595056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.596966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:29.738971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d2b9-6fd4-4339-90a0-236bd1ef6caa tempest-VolumeQuotaClassesTest-1573191828 tempest-VolumeQuotaClassesTest-1573191828-project-admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.849070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.850082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.850365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.850642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] PATH_INFO: `/v3/users/094658abc3de483ab931881aa71ae2a7` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.852327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094658abc3de483ab931881aa71ae2a7)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.855532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.879482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:29.944435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094658abc3de483ab931881aa71ae2a7'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.956978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094658abc3de483ab931881aa71ae2a7'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.978129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094658abc3de483ab931881aa71ae2a7'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.980137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094658abc3de483ab931881aa71ae2a7'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.988741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094658abc3de483ab931881aa71ae2a7'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:29.995735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1237/2439] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:29 2022] DELETE /identity/v3/users/094658abc3de483ab931881aa71ae2a7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:30.000338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.000629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.000911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.020016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:30.021395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:30.088633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1203/2440] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:30.098936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:30.100439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:30.159913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f83cde-458e-4ad6-8ef2-cc1f4e66bd40 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.164892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.165548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.165898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.166679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.176148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.177581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.187613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1238/2441] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:50:30.483618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:30.487953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:30.520057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:30.527544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f58327-44f4-420b-a863-a1bb97a6e8ef None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.535010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.535862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.536466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.537048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] PATH_INFO: `/v3/projects/a14132bb3d644bce9ffd189c748313b2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.538584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14132bb3d644bce9ffd189c748313b2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.540539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.586729 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14132bb3d644bce9ffd189c748313b2', 'request_id': 'req-513a27e7-1ec7-43a6-a560-e9f95d4153f7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.593757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14132bb3d644bce9ffd189c748313b2', 'request_id': 'req-513a27e7-1ec7-43a6-a560-e9f95d4153f7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.601298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14132bb3d644bce9ffd189c748313b2', 'request_id': 'req-513a27e7-1ec7-43a6-a560-e9f95d4153f7'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.612141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] The token cache is being invalidate because project a14132bb3d644bce9ffd189c748313b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:30.612431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.613076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.614636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1204/2442] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:30 2022] DELETE /identity/v3/projects/a14132bb3d644bce9ffd189c748313b2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:30.618731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:30.629551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd6255-ddc7-4233-8f47-761569aa4505 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.688584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.689540 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.689826 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.690104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] PATH_INFO: `/v3/users/c0c43fe2819d4fe3a75be6ae8f053230` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.691326 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c43fe2819d4fe3a75be6ae8f053230)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.693250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.736081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:30.743104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c43fe2819d4fe3a75be6ae8f053230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.752190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c43fe2819d4fe3a75be6ae8f053230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.775875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c43fe2819d4fe3a75be6ae8f053230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.776983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c43fe2819d4fe3a75be6ae8f053230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.786460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-54da71ef-e2b8-436d-b7bf-c37076bf8d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c43fe2819d4fe3a75be6ae8f053230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:30.793464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1239/2443] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:30 2022] DELETE /identity/v3/users/c0c43fe2819d4fe3a75be6ae8f053230 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:31.114182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.116608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.142656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a27e7-1ec7-43a6-a560-e9f95d4153f7 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.210331 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.211298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.211580 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.211855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] PATH_INFO: `/v3/projects/443a4259393c40f9a7e23b198aa5b11e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.213754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443a4259393c40f9a7e23b198aa5b11e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.215734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.265635 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443a4259393c40f9a7e23b198aa5b11e', 'request_id': 'req-039131d5-c53f-4e12-afe6-0d6602b14ec4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:31.271877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443a4259393c40f9a7e23b198aa5b11e', 'request_id': 'req-039131d5-c53f-4e12-afe6-0d6602b14ec4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:31.280539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443a4259393c40f9a7e23b198aa5b11e', 'request_id': 'req-039131d5-c53f-4e12-afe6-0d6602b14ec4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:31.291725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] The token cache is being invalidate because project 443a4259393c40f9a7e23b198aa5b11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:31.291951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:31.292602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-039131d5-c53f-4e12-afe6-0d6602b14ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:31.294165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1205/2444] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:31 2022] DELETE /identity/v3/projects/443a4259393c40f9a7e23b198aa5b11e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:31.299165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.299678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.299846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.318170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:31.319519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.388363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1240/2445] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:31.396217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.396594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.396952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.415669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:31.417485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.426330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1206/2446] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:50:31.430617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.440829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a547-aa6d-4483-95f0-398479819eec None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.445798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.446466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.446754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.447062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.447853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:31.448160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.449803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.462133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1241/2447] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:31.467258 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.476967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33054b4-0371-49f9-8acc-93024bbc32e3 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.481912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.482838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.483116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.483576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.484275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.486184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.490413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:31.516630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1207/2448] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:31.521117 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.539924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336506-cbd2-47af-9430-34394764c1ba admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.609914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.610795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.611210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.611589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.612395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.614435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.651508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1242/2449] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:31.652236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.666330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76b2b-dfc7-4daa-8623-9edb2565b7e4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.673265 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.674075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.674425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.674768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.675665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.677591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.695640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1208/2450] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:31.700674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.726181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c805-fdac-473c-a20e-2269e21daa92 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.728665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.730678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.732163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.733204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.733545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.733883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.734681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.736388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.752762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1243/2451] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:31.756985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.778627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246972df-9f46-4f1f-a42d-39f4e20f42ab admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.785192 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.786516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.787696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.787997 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] PATH_INFO: `/v3/projects/f0dba9629fe34eefb52bc25bc0794cfa/users/94970b1088b74c968e2743a744b273a4/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.804907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d08d7f-354f-4272-83d2-aa17344ec61d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.807683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dba9629fe34eefb52bc25bc0794cfa, user_id=94970b1088b74c968e2743a744b273a4, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.810580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532e134-83b3-48fd-97b4-a251f43ead19 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.811906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.813037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.813361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.813646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.816041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.821124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:31.834509 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1244/2452] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:31 2022] PUT /identity/v3/projects/f0dba9629fe34eefb52bc25bc0794cfa/users/94970b1088b74c968e2743a744b273a4/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:31.846053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.846335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.846609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.878776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] MFA Rules not processed for user `94970b1088b74c968e2743a744b273a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:31.880298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.920689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:31.923018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:31.937703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1209/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:50:31.959005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1245/2454] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:31.963219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.974199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d3ac-8d97-4a0c-91fd-88e902c9b7ea service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.041876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.042853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.043279 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.043797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.044749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.046772 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.093297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1210/2455] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:32.093457 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.110487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3d616-d671-4c97-bc6f-738f716be52a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.231179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.231869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.232156 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.232688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.233380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.235345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.272291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1246/2456] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:32 2022] POST /identity/v3/users => generated 306 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:32.276567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.285672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.293166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa6210-f4ff-4dd9-9bb5-c23476494a3a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.301312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.302068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.302357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.302638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.303441 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.305733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.327182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1211/2457] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:32.330072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.342177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14559-94be-4894-96c7-60b1998808a3 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.348530 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.349615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.349910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.350200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] PATH_INFO: `/v3/projects/2dc384cc051e4a88952371122b7ce1b4/users/f0d46f95655a4026810abb96e699a3f3/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.369766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc384cc051e4a88952371122b7ce1b4, user_id=f0d46f95655a4026810abb96e699a3f3, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.373114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.392817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1247/2458] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:32 2022] PUT /identity/v3/projects/2dc384cc051e4a88952371122b7ce1b4/users/f0d46f95655a4026810abb96e699a3f3/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:32.396506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.408189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e71e-2089-432c-bdca-cd7ab72bd92f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.475309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.475960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.476237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.476506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.477353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.479211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0846bc3-2546-4cde-be8f-646f8a92a8aa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.489760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1212/2459] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:50:32.494809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.518949 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ec9-6cee-4f7a-97b1-c49ca3b21255 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.525749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.527628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.528527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.528919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] PATH_INFO: `/v3/projects/2dc384cc051e4a88952371122b7ce1b4/users/f0d46f95655a4026810abb96e699a3f3/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.531669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc384cc051e4a88952371122b7ce1b4, user_id=f0d46f95655a4026810abb96e699a3f3, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.536371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.555420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1248/2460] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:32 2022] PUT /identity/v3/projects/2dc384cc051e4a88952371122b7ce1b4/users/f0d46f95655a4026810abb96e699a3f3/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:32.567019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.567667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.567667 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.611987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] MFA Rules not processed for user `f0d46f95655a4026810abb96e699a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:32.615987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:32.696543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1213/2461] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:32.707560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.710102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:32.764708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.781378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ec75-87b3-47c6-a1a1-3ea2c3141f03 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.785141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.785860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.786078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.786356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.796964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.798439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.809642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1249/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:32.883366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.894341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebf5dd-6ebb-4ea9-8904-a2848b1c3fd8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.897948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.898596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.898876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.899176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.959385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.960988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.970355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1214/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:33.321661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.330618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c4617-e456-430a-8fc8-0dcf59529f94 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.334521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.335206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.335488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.335773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.339924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:33.411584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:33.412929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:33.424476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1250/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:35.458798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.460296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:35.474565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.528269 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d98dd-0372-45eb-8fd4-6621adf99c22 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.533357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.534232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.534508 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.534782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] PATH_INFO: `/v3/users/f848993998124f8bbd1e158c3039d76c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.536055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f848993998124f8bbd1e158c3039d76c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.538014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.583073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f848993998124f8bbd1e158c3039d76c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.583769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f848993998124f8bbd1e158c3039d76c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.592523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f848993998124f8bbd1e158c3039d76c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.599367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f848993998124f8bbd1e158c3039d76c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.611646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f848993998124f8bbd1e158c3039d76c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.617636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1215/2465] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:35 2022] DELETE /identity/v3/users/f848993998124f8bbd1e158c3039d76c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:35.797765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.813335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2b3a-39b7-49c7-9d2e-012d08cde32c service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.885866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.886781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.887058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.887360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] PATH_INFO: `/v3/projects/1a3b96be88db4dd4b17172ff1ca55a0a` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.888650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3b96be88db4dd4b17172ff1ca55a0a)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.890875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.938951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3b96be88db4dd4b17172ff1ca55a0a', 'request_id': 'req-671d0d42-c210-4a2d-b9e2-417a5a41ddde'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.947823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3b96be88db4dd4b17172ff1ca55a0a', 'request_id': 'req-671d0d42-c210-4a2d-b9e2-417a5a41ddde'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.953483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3b96be88db4dd4b17172ff1ca55a0a', 'request_id': 'req-671d0d42-c210-4a2d-b9e2-417a5a41ddde'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.960464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.965461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] The token cache is being invalidate because project 1a3b96be88db4dd4b17172ff1ca55a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:35.965917 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.966654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-671d0d42-c210-4a2d-b9e2-417a5a41ddde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:35.968667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1251/2466] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:35 2022] DELETE /identity/v3/projects/1a3b96be88db4dd4b17172ff1ca55a0a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:37.103017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.104572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:37.118329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8fab-a874-4e92-b0db-d9aa0efa5b46 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.193013 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.193892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.194170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.194439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] PATH_INFO: `/v3/users/94970b1088b74c968e2743a744b273a4` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.195995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94970b1088b74c968e2743a744b273a4)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.198167 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.234646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:37.249887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94970b1088b74c968e2743a744b273a4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.250493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94970b1088b74c968e2743a744b273a4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.261355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94970b1088b74c968e2743a744b273a4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.268876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94970b1088b74c968e2743a744b273a4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.282970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94970b1088b74c968e2743a744b273a4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.289242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1216/2467] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:37 2022] DELETE /identity/v3/users/94970b1088b74c968e2743a744b273a4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:37.293911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.294388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.294472 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.311734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:37.312945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:37.381271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1252/2468] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:37.391234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.392701 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:37.453976 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea236-d5b6-445b-a87d-ea5722444f69 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.458252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.458936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.459256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.459619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.470249 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.471753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.483077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1217/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:37.775658 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.777052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:37.792294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734a285-a1ea-4aaf-aa0b-400799929b3b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.797415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.798365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.798650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.798928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] PATH_INFO: `/v3/projects/f0dba9629fe34eefb52bc25bc0794cfa` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.800274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0dba9629fe34eefb52bc25bc0794cfa)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.802401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.848279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0dba9629fe34eefb52bc25bc0794cfa', 'request_id': 'req-0a310832-3a5b-4eb6-b749-606c3ab2c39c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.855962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0dba9629fe34eefb52bc25bc0794cfa', 'request_id': 'req-0a310832-3a5b-4eb6-b749-606c3ab2c39c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.861899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0dba9629fe34eefb52bc25bc0794cfa', 'request_id': 'req-0a310832-3a5b-4eb6-b749-606c3ab2c39c'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.873536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] The token cache is being invalidate because project f0dba9629fe34eefb52bc25bc0794cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:37.873824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.874450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:37.876018 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1253/2470] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:37 2022] DELETE /identity/v3/projects/f0dba9629fe34eefb52bc25bc0794cfa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:37.879953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.889591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ea92-7acb-41cf-ae73-0e89c77e9c43 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.950467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.951364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.951643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.951917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] PATH_INFO: `/v3/users/f0d46f95655a4026810abb96e699a3f3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.953078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d46f95655a4026810abb96e699a3f3)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.955021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.000683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d46f95655a4026810abb96e699a3f3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.001316 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d46f95655a4026810abb96e699a3f3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.008040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d46f95655a4026810abb96e699a3f3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.009391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:38.018400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d46f95655a4026810abb96e699a3f3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.030487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2455f921-2dd9-464e-ba15-b367e3d56bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d46f95655a4026810abb96e699a3f3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.036675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1218/2471] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:37 2022] DELETE /identity/v3/users/f0d46f95655a4026810abb96e699a3f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:38.306058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.307669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.320840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310832-3a5b-4eb6-b749-606c3ab2c39c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.379778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.380686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.380960 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.381232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] PATH_INFO: `/v3/projects/2dc384cc051e4a88952371122b7ce1b4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.382550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc384cc051e4a88952371122b7ce1b4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.384484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.412356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:38.438193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc384cc051e4a88952371122b7ce1b4', 'request_id': 'req-f8610974-eb4c-4967-a0d4-e7bd23897b48'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.445811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc384cc051e4a88952371122b7ce1b4', 'request_id': 'req-f8610974-eb4c-4967-a0d4-e7bd23897b48'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.451483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc384cc051e4a88952371122b7ce1b4', 'request_id': 'req-f8610974-eb4c-4967-a0d4-e7bd23897b48'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.460520 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91f9ea-0a47-4cad-9539-8f5c6fff2397 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.460990 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91f9ea-0a47-4cad-9539-8f5c6fff2397 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.461118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91f9ea-0a47-4cad-9539-8f5c6fff2397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.463961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] The token cache is being invalidate because project 2dc384cc051e4a88952371122b7ce1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:38.464445 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.465087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f8610974-eb4c-4967-a0d4-e7bd23897b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:38.466799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1254/2472] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:38 2022] DELETE /identity/v3/projects/2dc384cc051e4a88952371122b7ce1b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:38.471277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.471567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.471855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.480813 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7f91f9ea-0a47-4cad-9539-8f5c6fff2397 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.482039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7f91f9ea-0a47-4cad-9539-8f5c6fff2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.490496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.491768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.539406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1219/2473] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:50:38.551039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1255/2474] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:50:38.560034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.560502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.560779 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.580161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.581376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.588189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.589665 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.590128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1220/2475] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:38.594045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.603464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8ab48-5d69-4239-ae22-81efc9cadee7 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.608486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.609133 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.609417 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.609698 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.610423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:38.610794 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.612392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.624714 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1221/2476] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:38.628834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.639544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642493d-aabf-4671-8b25-438d8ab5d1a4 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.644111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.644941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.645224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.645499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.646168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.648128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.664948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaaf5d-3182-44ee-be3c-66eac1d54632 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.670833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.671510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.671796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.672074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.675786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1222/2477] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:38.680250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.680961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.682824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.692415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1256/2478] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:50:38.749457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4002-5cc4-4757-bf37-571c35f540a3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.754351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.755107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.755426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.755702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.756386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.758398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.781550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1223/2479] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:38.785425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.797645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fd3c-bc5d-469a-a8cb-99d93de7a5e9 service swift] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.802538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.803122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.803513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.803681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.804385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.805963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.817067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1257/2480] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:38.821377 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.832400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafeb9-d741-4726-ac4b-729567f4fcd2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.838460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.839406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.839762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.840195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.841050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.842773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cd09-4104-4ed5-ab76-f0caea57a4d5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.857819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1224/2481] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:38.859014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.870038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ff96-c660-4515-bb1c-4bae4742a9ac admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.874806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.875724 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.876006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.876282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] PATH_INFO: `/v3/projects/a7a13852197a45b08e8c8b466b2e2976/users/0b9ba5f91be44acc8b48a2188a5cee28/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.892261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a13852197a45b08e8c8b466b2e2976, user_id=0b9ba5f91be44acc8b48a2188a5cee28, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.895892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.911012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1258/2482] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:38 2022] PUT /identity/v3/projects/a7a13852197a45b08e8c8b466b2e2976/users/0b9ba5f91be44acc8b48a2188a5cee28/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:38.921554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.922054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.922338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.946859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:38.950970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] MFA Rules not processed for user `0b9ba5f91be44acc8b48a2188a5cee28`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.952905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:39.021619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1225/2483] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:39.026408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.036073 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.095400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8445-a18b-4252-87cf-b6d37b4e6cc5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.100056 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.100717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.100995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.101269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.101963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.104092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.132309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1259/2484] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:39.137001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.147577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1fea-77e0-4a7c-b12e-3a1728d9d4f6 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.205864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.206543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.206827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.207105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.207889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.209825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.230196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1226/2485] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:39.234441 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.245321 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735bc94-083e-459f-8da1-914c32957acd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.249940 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.250604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.250883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.251184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.251906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.253576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.264908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1260/2486] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:39.268960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.279113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689bb0-dc6b-4232-95cb-f73458bd28b8 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.284234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.284934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.285219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.285498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.286263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.287936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338620e8-855d-46c7-8704-ea1edc7bddf9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.299002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1227/2487] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:39.303883 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.314581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9014-a802-4dff-9531-67f3e9b0ad9e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.319176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.320086 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.320359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.320627 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] PATH_INFO: `/v3/projects/f69c552d63424bd1ad8c4299786c2f8f/users/42089696cbeb4fb2a333cc115f694fb4/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.340915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69c552d63424bd1ad8c4299786c2f8f, user_id=42089696cbeb4fb2a333cc115f694fb4, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.343964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.361564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1261/2488] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:39 2022] PUT /identity/v3/projects/f69c552d63424bd1ad8c4299786c2f8f/users/42089696cbeb4fb2a333cc115f694fb4/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:39.372724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.373021 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.373305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.401228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] MFA Rules not processed for user `42089696cbeb4fb2a333cc115f694fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:39.402459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:39.469688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1228/2489] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:39.474691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.539380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eee8e-0703-4585-93bf-162ef59c2769 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.544419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.545089 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.545373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.545648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.546382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.548791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.576559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1262/2490] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:39.580582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.592405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61590-29e1-43d7-88c8-79c8b93cf48a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.600943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.652234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.652967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.653259 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.653544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.654235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.656236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.679586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1229/2491] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:39.680819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.691906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ca6b7-24c4-4dd1-a959-c525f6b5a37d admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.697692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.698363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.698647 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.698925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.699692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.701338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.715344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1263/2492] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:39.716324 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.726352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831403d-a712-426c-b14f-3f304f2d738a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.731771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.733095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.733373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.733648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] PATH_INFO: `/v3/projects/b0a6432c77d24dc188f31548d97eb654/users/7c564794bd1f4fc3857136c59b1ca611/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.749207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a6432c77d24dc188f31548d97eb654, user_id=7c564794bd1f4fc3857136c59b1ca611, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.751906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.768827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1230/2493] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:39 2022] PUT /identity/v3/projects/b0a6432c77d24dc188f31548d97eb654/users/7c564794bd1f4fc3857136c59b1ca611/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:39.772830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.784644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f122c7-ad90-4bc8-977c-513f87d58a2b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.815401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.843804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.844483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.844768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.845048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.845767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.847405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0a455-8ab4-40c4-8dd5-f6f9f3028131 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.858038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1264/2494] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:39.862077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.874292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdedf-881a-4a73-be61-51baa433578f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.878918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.879838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.880120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.880456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] PATH_INFO: `/v3/projects/b0a6432c77d24dc188f31548d97eb654/users/7c564794bd1f4fc3857136c59b1ca611/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.882453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a6432c77d24dc188f31548d97eb654, user_id=7c564794bd1f4fc3857136c59b1ca611, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.885881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.896427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1231/2495] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:39 2022] PUT /identity/v3/projects/b0a6432c77d24dc188f31548d97eb654/users/7c564794bd1f4fc3857136c59b1ca611/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:39.915265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.916119 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.916984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.947351 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] MFA Rules not processed for user `7c564794bd1f4fc3857136c59b1ca611`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:39.948662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:40.029464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1265/2496] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:40.041077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.043053 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:40.107104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839100a-13dd-4acb-b776-0f12076f08b5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.111586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.112357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.112757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.113134 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.124868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.126961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.138668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1232/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:40.184394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.185708 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:40.199754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76ed15-7924-41fb-9fe9-1b280b601b1f None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.204364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.205040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.205328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.205657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.284304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.285789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2e30c-068f-49a9-8b84-440b23056e25 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.295419 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1266/2498] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:43.303517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.372983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865a175-4e15-4926-8af7-4dad9efc7946 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.377531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.378407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.378685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.378958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] PATH_INFO: `/v3/users/0b9ba5f91be44acc8b48a2188a5cee28` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.380176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9ba5f91be44acc8b48a2188a5cee28)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.382110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.388958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.430322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9ba5f91be44acc8b48a2188a5cee28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:43.430887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9ba5f91be44acc8b48a2188a5cee28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:43.439752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9ba5f91be44acc8b48a2188a5cee28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:43.447660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9ba5f91be44acc8b48a2188a5cee28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:43.462006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9ba5f91be44acc8b48a2188a5cee28'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:43.468760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1233/2499] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:43 2022] DELETE /identity/v3/users/0b9ba5f91be44acc8b48a2188a5cee28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:43.473428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.473890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.474031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.491824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:43.493033 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:43.540458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=100 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.567466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1267/2500] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:50:43.578603 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.580651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:43.644865 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21115c8-706f-47f4-a4cd-3c9bcfbacf9f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.649000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.649692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.650137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.650423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.660521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.661964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.672983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1234/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:44.089363 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.090769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:44.102765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f09c33-09ef-4fb2-90cf-18694c696805 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.108293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.109152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.109431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.109703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] PATH_INFO: `/v3/projects/a7a13852197a45b08e8c8b466b2e2976` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.110874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a13852197a45b08e8c8b466b2e2976)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.112815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.173304 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a13852197a45b08e8c8b466b2e2976', 'request_id': 'req-631ed76f-0818-4094-85bb-a2df0345ab91'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.184548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a13852197a45b08e8c8b466b2e2976', 'request_id': 'req-631ed76f-0818-4094-85bb-a2df0345ab91'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.191123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a13852197a45b08e8c8b466b2e2976', 'request_id': 'req-631ed76f-0818-4094-85bb-a2df0345ab91'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.212104 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] The token cache is being invalidate because project a7a13852197a45b08e8c8b466b2e2976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:44.215408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.216953 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.219796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1268/2502] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:44 2022] DELETE /identity/v3/projects/a7a13852197a45b08e8c8b466b2e2976 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:44.223716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.236186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0f75-4c51-486f-a088-94ef98ebe93f service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.311375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.312425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.312771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.313487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] PATH_INFO: `/v3/users/42089696cbeb4fb2a333cc115f694fb4` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.314387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42089696cbeb4fb2a333cc115f694fb4)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.316395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.368369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.388381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42089696cbeb4fb2a333cc115f694fb4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.389057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42089696cbeb4fb2a333cc115f694fb4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.399777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42089696cbeb4fb2a333cc115f694fb4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.408784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42089696cbeb4fb2a333cc115f694fb4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.423404 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42089696cbeb4fb2a333cc115f694fb4'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.430128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1235/2503] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:44 2022] DELETE /identity/v3/users/42089696cbeb4fb2a333cc115f694fb4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:44.740246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.744935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:44.759942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed76f-0818-4094-85bb-a2df0345ab91 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.823096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.823992 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.824265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.824541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] PATH_INFO: `/v3/projects/f69c552d63424bd1ad8c4299786c2f8f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.825750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69c552d63424bd1ad8c4299786c2f8f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.827689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.876879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69c552d63424bd1ad8c4299786c2f8f', 'request_id': 'req-17ad513f-8eec-4bba-968c-c6b6657767d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.885660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69c552d63424bd1ad8c4299786c2f8f', 'request_id': 'req-17ad513f-8eec-4bba-968c-c6b6657767d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.892007 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69c552d63424bd1ad8c4299786c2f8f', 'request_id': 'req-17ad513f-8eec-4bba-968c-c6b6657767d4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.903925 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] The token cache is being invalidate because project f69c552d63424bd1ad8c4299786c2f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:44.904214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.904868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:44.906423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1269/2504] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:44 2022] DELETE /identity/v3/projects/f69c552d63424bd1ad8c4299786c2f8f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:44.910529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.911980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:44.925143 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5397ae9-b854-4566-a41c-7e4c73545803 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.984479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.985538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.985780 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.986058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] PATH_INFO: `/v3/users/7c564794bd1f4fc3857136c59b1ca611` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.987291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c564794bd1f4fc3857136c59b1ca611)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.989232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.054387 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c564794bd1f4fc3857136c59b1ca611'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.055264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c564794bd1f4fc3857136c59b1ca611'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.065932 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c564794bd1f4fc3857136c59b1ca611'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.075515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c564794bd1f4fc3857136c59b1ca611'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.088938 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-bf6b71f5-8bca-41f0-8ab8-2defe8798879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c564794bd1f4fc3857136c59b1ca611'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.095837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1236/2505] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:44 2022] DELETE /identity/v3/users/7c564794bd1f4fc3857136c59b1ca611 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:45.406223 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.407892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:45.418846 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:45.429289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad513f-8eec-4bba-968c-c6b6657767d4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.515447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.516276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.516562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.516840 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] PATH_INFO: `/v3/projects/b0a6432c77d24dc188f31548d97eb654` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.518227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a6432c77d24dc188f31548d97eb654)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.520386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.585374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a6432c77d24dc188f31548d97eb654', 'request_id': 'req-6bd0779e-a853-40db-9d00-94277bd48d44'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.607076 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a6432c77d24dc188f31548d97eb654', 'request_id': 'req-6bd0779e-a853-40db-9d00-94277bd48d44'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.613744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a6432c77d24dc188f31548d97eb654', 'request_id': 'req-6bd0779e-a853-40db-9d00-94277bd48d44'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.633059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] The token cache is being invalidate because project b0a6432c77d24dc188f31548d97eb654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:45.633355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.634294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-6bd0779e-a853-40db-9d00-94277bd48d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:45.639213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1270/2506] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:45 2022] DELETE /identity/v3/projects/b0a6432c77d24dc188f31548d97eb654 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:45.642538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.642996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.643094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.662665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:45.663952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:45.688614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:45.757707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1237/2507] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:45.766669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.767632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.768099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.788951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:45.790664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:45.803098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1271/2508] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:45.804256 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.817800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a277fb5-f665-491e-b742-9730cab7125c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.831276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.832300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.832600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.833169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.833599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:45.833913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.836728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.858953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1238/2509] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:45.863157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.875360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe267d-f73d-4804-9edc-469efa40ef69 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.880366 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.881154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.881911 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.882199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.883201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.885858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.916372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1272/2510] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:45 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:45.917672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.937848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705a2e8-ba82-4188-9fde-6f337689f375 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.968951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.970936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.001083 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.001795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.002080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.002357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.003071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.005078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.029637 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1239/2511] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:45 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:46.030591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.040728 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d8dda-72aa-4036-8408-69199ac15ab2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.042154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a151b-36d3-4fe1-854f-0bbae47991fe admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.045712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.046405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.046689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.046789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.046961 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.047706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.047807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.048071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.048376 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] PATH_INFO: `/v3/users/ede6a0e1333e46f58a32fdff3f6abab0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.049299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.049580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede6a0e1333e46f58a32fdff3f6abab0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.051538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.059529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:46.060467 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1240/2512] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:50:46.064425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.080790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d030fc-9fd4-4af5-9435-d21ee26ff85c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.086152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.086945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.087424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.087733 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.088607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.090221 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.101764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1241/2513] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:50:46.103637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede6a0e1333e46f58a32fdff3f6abab0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.106689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.111395 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede6a0e1333e46f58a32fdff3f6abab0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.117369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d90a-0390-4de5-9704-5ba91c36541f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.123700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.124676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.125074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.125207 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede6a0e1333e46f58a32fdff3f6abab0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.125409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] PATH_INFO: `/v3/projects/d8e106396c004484a02a2cbd19006e75/users/c333f663ade64cb9a3ee93dad2295167/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.126144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede6a0e1333e46f58a32fdff3f6abab0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.133080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-7af5c93f-7b5d-4414-a6f2-52193c1c7a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede6a0e1333e46f58a32fdff3f6abab0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.139639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1273/2514] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:45 2022] DELETE /identity/v3/users/ede6a0e1333e46f58a32fdff3f6abab0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:46.140638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e106396c004484a02a2cbd19006e75, user_id=c333f663ade64cb9a3ee93dad2295167, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.143367 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.157193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1242/2515] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:46 2022] PUT /identity/v3/projects/d8e106396c004484a02a2cbd19006e75/users/c333f663ade64cb9a3ee93dad2295167/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:46.169133 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.169422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.169705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.198482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] MFA Rules not processed for user `c333f663ade64cb9a3ee93dad2295167`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:46.199905 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.277994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1274/2516] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:46.282412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.284178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.336148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.337836 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.366152 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:46.377283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c6ab8-72af-43c1-9202-7ab92ebbd095 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.384138 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.384868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.385150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.385425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.386140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.388361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.416427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1243/2517] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:46 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:46.420220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.429998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229b3be-4410-4177-9bd9-45ae08944787 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.448839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:46.483705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c837-35fb-4adc-a62f-f46f219f140e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.488486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.489146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.489432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.489705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.490039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.490386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.490904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.491210 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.491606 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] PATH_INFO: `/v3/projects/a2dfdde6f5f04373837b84353f5697d6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.492328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.492798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dfdde6f5f04373837b84353f5697d6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.494819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.518579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1244/2518] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:46 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:46.519617 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.530704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc597760-0ee3-485b-a0d2-590c4a0d5d98 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.545176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dfdde6f5f04373837b84353f5697d6', 'request_id': 'req-55657918-e03d-4563-84af-ca870bad224f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.553161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dfdde6f5f04373837b84353f5697d6', 'request_id': 'req-55657918-e03d-4563-84af-ca870bad224f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.559747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dfdde6f5f04373837b84353f5697d6', 'request_id': 'req-55657918-e03d-4563-84af-ca870bad224f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.572095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] The token cache is being invalidate because project a2dfdde6f5f04373837b84353f5697d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:46.572428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.573094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.575116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1275/2519] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:46 2022] DELETE /identity/v3/projects/a2dfdde6f5f04373837b84353f5697d6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:46.578731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.580062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.590832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.591539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.591829 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.592110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.592868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.594472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.605057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1245/2520] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:50:46.609789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.611479 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.623808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33893-3c4b-49f5-ad27-e8cf57a4faad admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.628884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.629922 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.630298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.630738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] PATH_INFO: `/v3/projects/a70100460d5148b88cd99335cc4eca28/users/cb4328ef67ed47928e42c6f4f5561da0/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.645692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657918-e03d-4563-84af-ca870bad224f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.645898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70100460d5148b88cd99335cc4eca28, user_id=cb4328ef67ed47928e42c6f4f5561da0, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.648553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.651250 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.652137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.652420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.652693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] PATH_INFO: `/v3/users/416b7f6b34304cacba32ba4b1060c7a2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.654031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=416b7f6b34304cacba32ba4b1060c7a2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.656248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.663778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1246/2521] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:46 2022] PUT /identity/v3/projects/a70100460d5148b88cd99335cc4eca28/users/cb4328ef67ed47928e42c6f4f5561da0/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:46.668499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.707322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416b7f6b34304cacba32ba4b1060c7a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.715422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416b7f6b34304cacba32ba4b1060c7a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.715924 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:46.716586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:46.731807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416b7f6b34304cacba32ba4b1060c7a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.732798 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416b7f6b34304cacba32ba4b1060c7a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.735567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e032b3-4b37-473b-b069-38a1d816b636 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.740024 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416b7f6b34304cacba32ba4b1060c7a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:46.740239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.740903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.741185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.741562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.742278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.744311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb9128-c088-451a-acea-6b91ec68e4a5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.746455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1276/2522] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:46 2022] DELETE /identity/v3/users/416b7f6b34304cacba32ba4b1060c7a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:46.757349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1247/2523] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:50:46.758593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.760896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.827093 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52451f-9d4f-4bba-99d0-939698ac24ba admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:46.831980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:46.832876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.833151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.833421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] PATH_INFO: `/v3/projects/a70100460d5148b88cd99335cc4eca28/users/cb4328ef67ed47928e42c6f4f5561da0/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.835425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70100460d5148b88cd99335cc4eca28, user_id=cb4328ef67ed47928e42c6f4f5561da0, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:46.839155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:46.849814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1277/2524] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:46 2022] PUT /identity/v3/projects/a70100460d5148b88cd99335cc4eca28/users/cb4328ef67ed47928e42c6f4f5561da0/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:46.860682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:46.861052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:46.861399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:46.888255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] MFA Rules not processed for user `cb4328ef67ed47928e42c6f4f5561da0`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:46.889474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.922642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.924389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.971918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1248/2525] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:46.983471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:46.984828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:46.997600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6c64-2974-4283-8b25-8f2fd7d5efd8 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:47.002565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:47.003465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:47.003751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:47.004029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] PATH_INFO: `/v3/projects/a318c2e884a146af9e81bc00596dcd77` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:47.005235 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a318c2e884a146af9e81bc00596dcd77)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:47.007208 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:47.043789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cde728-a121-4ac6-b3de-3193d956cbbd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:47.056662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a318c2e884a146af9e81bc00596dcd77', 'request_id': 'req-59a17756-b26b-4c84-b631-ed7c6125498e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.064799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a318c2e884a146af9e81bc00596dcd77', 'request_id': 'req-59a17756-b26b-4c84-b631-ed7c6125498e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.070656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a318c2e884a146af9e81bc00596dcd77', 'request_id': 'req-59a17756-b26b-4c84-b631-ed7c6125498e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.073484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:47.084862 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] The token cache is being invalidate because project a318c2e884a146af9e81bc00596dcd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:47.085211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.086035 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.088458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1278/2526] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:46 2022] DELETE /identity/v3/projects/a318c2e884a146af9e81bc00596dcd77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:47.096512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:47.097185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:47.097463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:47.097737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:47.099704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:47.141318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:47.173836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:47.175358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f7560-f93e-4a53-8aa4-56d740e44ea0 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:47.186948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1249/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:50:47.726932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:47.728771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:47.793496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17756-b26b-4c84-b631-ed7c6125498e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:47.798118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:47.799016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:47.799331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:47.799613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] PATH_INFO: `/v3/users/c333f663ade64cb9a3ee93dad2295167` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:47.800792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c333f663ade64cb9a3ee93dad2295167)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:47.802721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:47.849518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c333f663ade64cb9a3ee93dad2295167'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.857385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c333f663ade64cb9a3ee93dad2295167'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.870079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c333f663ade64cb9a3ee93dad2295167'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.870702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c333f663ade64cb9a3ee93dad2295167'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.877529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c333f663ade64cb9a3ee93dad2295167'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:47.883368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1279/2528] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:47 2022] DELETE /identity/v3/users/c333f663ade64cb9a3ee93dad2295167 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:47.888386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:47.888845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:47.888942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:47.905688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:47.906860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:47.966910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1250/2529] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:47.976644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:47.978178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.034542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c780941-4e16-44a7-8201-103f1ce64629 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.038132 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.038769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.039051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.039409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.048502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.049916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.060313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1280/2530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:48.334596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.336093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.349354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c670-fff9-4dba-98a9-a08cc84c0fcb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.354711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.355619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.355901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.356176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] PATH_INFO: `/v3/projects/d8e106396c004484a02a2cbd19006e75` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.357376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e106396c004484a02a2cbd19006e75)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.359810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.406449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e106396c004484a02a2cbd19006e75', 'request_id': 'req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.412349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e106396c004484a02a2cbd19006e75', 'request_id': 'req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.420120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e106396c004484a02a2cbd19006e75', 'request_id': 'req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.430246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] The token cache is being invalidate because project d8e106396c004484a02a2cbd19006e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:48.430529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.431853 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.433402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1251/2531] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:48 2022] DELETE /identity/v3/projects/d8e106396c004484a02a2cbd19006e75 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:48.437394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.447323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690a1e-dd30-4bbe-a089-6d270e19ad84 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.459703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.504982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.505854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.506140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.506414 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] PATH_INFO: `/v3/users/cb4328ef67ed47928e42c6f4f5561da0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.507630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4328ef67ed47928e42c6f4f5561da0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.509597 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.554869 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4328ef67ed47928e42c6f4f5561da0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.562879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4328ef67ed47928e42c6f4f5561da0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.574754 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4328ef67ed47928e42c6f4f5561da0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.575404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4328ef67ed47928e42c6f4f5561da0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.582145 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d93d1456-fd59-4f36-a191-6e1c2e5214fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4328ef67ed47928e42c6f4f5561da0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:48.588042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1281/2532] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:48 2022] DELETE /identity/v3/users/cb4328ef67ed47928e42c6f4f5561da0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:48.868992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.870604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.887657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4bf66-fd39-4d46-9b3c-991d57a9caad admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.938350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.946640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.947652 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.948129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.948460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] PATH_INFO: `/v3/projects/a70100460d5148b88cd99335cc4eca28` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.949819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70100460d5148b88cd99335cc4eca28)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.951785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.997492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70100460d5148b88cd99335cc4eca28', 'request_id': 'req-9a9b5366-4a63-467d-8670-a5fc4d7605cb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.003562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70100460d5148b88cd99335cc4eca28', 'request_id': 'req-9a9b5366-4a63-467d-8670-a5fc4d7605cb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.011573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70100460d5148b88cd99335cc4eca28', 'request_id': 'req-9a9b5366-4a63-467d-8670-a5fc4d7605cb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.022166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] The token cache is being invalidate because project a70100460d5148b88cd99335cc4eca28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:49.022452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.023093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9a9b5366-4a63-467d-8670-a5fc4d7605cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.025232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1252/2533] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:48 2022] DELETE /identity/v3/projects/a70100460d5148b88cd99335cc4eca28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:49.030420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.030894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.030990 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.048621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.049817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.108703 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1282/2534] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:49.116600 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.116892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.117206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.137113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.138317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.146292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1253/2535] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:49.151019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.160689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2ea6-a73d-42bd-bc47-5d9f185b120c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.165277 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.165927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.166203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.166476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.167224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:49.167559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.169138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.180432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1283/2536] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:49.184872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.193969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda68a-0747-4f83-aa65-77dd5e6d992e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.199576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.200155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.200435 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.200708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.201393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.203306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.228899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1254/2537] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:49.233338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.243071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036014-a639-4eec-97a1-7c9d33518679 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.263337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.302216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.302879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.303193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.303474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.304164 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.306092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.325696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1284/2538] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:49.329789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.341157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f06984-12e1-4f4b-9bab-7b9aa3483d3b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.345852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.346539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.346819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.347120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.347872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.349464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.360557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1255/2539] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:49.364490 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.374972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce04e-413b-47ff-af38-5a120ae2ae01 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.379632 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.380287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.380573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.380859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.381581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.383196 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523aa4b-ffb1-456f-9a49-ed36cace73d6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.394063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1285/2540] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:49.397867 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.407633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d18f42-91b0-4c0c-ba60-974bd719e8fd admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.412349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.413216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.413500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.413773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] PATH_INFO: `/v3/projects/6f44fe9d33d049559c6323eb9c3821b8/users/2eac40b1fedf4bef8e1dc5232ce8ffb4/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.428047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f44fe9d33d049559c6323eb9c3821b8, user_id=2eac40b1fedf4bef8e1dc5232ce8ffb4, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.430679 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.444199 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1256/2541] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:49 2022] PUT /identity/v3/projects/6f44fe9d33d049559c6323eb9c3821b8/users/2eac40b1fedf4bef8e1dc5232ce8ffb4/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:49.508510 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.508722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.509655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.535913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] MFA Rules not processed for user `2eac40b1fedf4bef8e1dc5232ce8ffb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.537127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.601118 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1286/2542] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:49.613194 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.614889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.670860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8608cb-e09f-4b70-8059-859b2943f7dc admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.674510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.675162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.675457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.675734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.684638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.686062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae54325-84fc-4648-9863-bec5b636e329 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.694763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1257/2543] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:49.714881 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.778817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf623-8394-48d6-8860-a6d0741523cc None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.783382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.784254 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.784541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.784817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] PATH_INFO: `/v3/users/2eac40b1fedf4bef8e1dc5232ce8ffb4` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.786015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eac40b1fedf4bef8e1dc5232ce8ffb4)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.787981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.825388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.836088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eac40b1fedf4bef8e1dc5232ce8ffb4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.844141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eac40b1fedf4bef8e1dc5232ce8ffb4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.856734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eac40b1fedf4bef8e1dc5232ce8ffb4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.857389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eac40b1fedf4bef8e1dc5232ce8ffb4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.864394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eac40b1fedf4bef8e1dc5232ce8ffb4'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:49.870966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1287/2544] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:49 2022] DELETE /identity/v3/users/2eac40b1fedf4bef8e1dc5232ce8ffb4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:49.875524 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.875869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.876129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.892771 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.893967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.912506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.954272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1258/2545] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:49.964080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.965502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:50.024966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9ccf1-b6ba-4fc7-8e69-93f748bd4801 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.028752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.029463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.029680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.029951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.039040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.041059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc761e-dd3e-4329-9e33-e09de7949075 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.050486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1288/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:50.321539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.323751 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:50.341660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a33eb-e677-4ae5-8ba1-df0884dcdf9a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.350311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.351873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.352356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.353432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] PATH_INFO: `/v3/projects/6f44fe9d33d049559c6323eb9c3821b8` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.355602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f44fe9d33d049559c6323eb9c3821b8)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.359674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.406500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f44fe9d33d049559c6323eb9c3821b8', 'request_id': 'req-034856c5-93d9-4443-9959-06a48d7d6f3e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:50.413043 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f44fe9d33d049559c6323eb9c3821b8', 'request_id': 'req-034856c5-93d9-4443-9959-06a48d7d6f3e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:50.421036 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f44fe9d33d049559c6323eb9c3821b8', 'request_id': 'req-034856c5-93d9-4443-9959-06a48d7d6f3e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:50.431275 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] The token cache is being invalidate because project 6f44fe9d33d049559c6323eb9c3821b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:50.431566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:50.432190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-034856c5-93d9-4443-9959-06a48d7d6f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:50.433736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1259/2547] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:50 2022] DELETE /identity/v3/projects/6f44fe9d33d049559c6323eb9c3821b8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:50.438833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.439127 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.439508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.457579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:50.458805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:50.518580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1289/2548] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:50.527092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.527413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.527699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.547573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:50.548799 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:50.557453 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1260/2549] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:50.561604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.571532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e05ad-f411-4ea7-aea0-38fcec2799c3 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.576112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.576768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.577052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.577331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.578059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:50.578367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.580022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.591565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1290/2550] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:50.595643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.605311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2169e-b0c1-4102-bcfb-1b8e3b830003 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.610251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.610902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.611214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.611495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.612183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.614085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.639633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1261/2551] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:50.643738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.653998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2b3f0-79a8-41df-8f63-a6141120651f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.694784 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:50.712243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.712918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.713202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.713477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.714170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.716123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.735430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1291/2552] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:50.739539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.750292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a413dfe-81d0-47c4-bb39-471d328bcc00 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.754965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.755659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.755941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.756218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.756940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.758561 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.768948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1262/2553] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:50.772808 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.782961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20c890-a179-489b-bf51-9fd56fb930ac admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.787623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.788276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.788558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.788837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.789558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.791803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596532f-09dd-4f01-8eee-78a9013c434c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.801621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1292/2554] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:50.805493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.815860 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80570f8-9596-4b92-811b-3a830d577b37 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.820492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.821364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.822102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.822328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] PATH_INFO: `/v3/projects/095c9c7f562e46dba55561f94afd618d/users/3f683d9cd305465d8db00f5bc62472e0/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.836609 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095c9c7f562e46dba55561f94afd618d, user_id=3f683d9cd305465d8db00f5bc62472e0, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.839402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.852399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1263/2555] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:50 2022] PUT /identity/v3/projects/095c9c7f562e46dba55561f94afd618d/users/3f683d9cd305465d8db00f5bc62472e0/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:50.863266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.863589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.863874 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.890465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] MFA Rules not processed for user `3f683d9cd305465d8db00f5bc62472e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:50.891714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:50.955365 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1293/2556] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:50.959811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.004646 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:51.022395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbadbe6-a03e-402f-b00c-b971022caf19 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.027734 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.028394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.028676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.028954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.029674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.031631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.056708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1264/2557] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:50 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:51.060959 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.071696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a8838-4032-42f5-818c-be7775a869ee None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.129517 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.130199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.130483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.130762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.131498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.133411 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.153471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1294/2558] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:51 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:51.157688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.168671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693a13e-bc96-45f0-aefe-3045518f13a7 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.173240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.174149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.174436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.174718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.175469 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.177057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.187535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1265/2559] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:51.191669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.201565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a77d4-d6b0-45f1-9b3c-5dd12e84e4d2 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.206244 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.207124 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.207435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.207713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] PATH_INFO: `/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0/users/55f0b1c820624a8ebe2a0795f6e64ca0/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.222558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a54fa50bf5843afb17068fe2eafc7c0, user_id=55f0b1c820624a8ebe2a0795f6e64ca0, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.225259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.238667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1295/2560] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:51 2022] PUT /identity/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0/users/55f0b1c820624a8ebe2a0795f6e64ca0/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:51.242481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.252388 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1fce2-bcd4-47da-8b4d-7f4d034b855c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.308109 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.308769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.309055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.309332 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.310079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.311710 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3ed05-e155-4a81-84cd-6679e593ac77 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.321420 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1266/2561] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:51.326393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.336902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc8b9-717b-4b0c-870a-e6022c5bb651 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.342218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.343116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.343444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.343723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] PATH_INFO: `/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0/users/55f0b1c820624a8ebe2a0795f6e64ca0/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.345728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a54fa50bf5843afb17068fe2eafc7c0, user_id=55f0b1c820624a8ebe2a0795f6e64ca0, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.348454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.359422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1296/2562] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:51 2022] PUT /identity/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0/users/55f0b1c820624a8ebe2a0795f6e64ca0/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:51.370660 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.370955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.371305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.397339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] MFA Rules not processed for user `55f0b1c820624a8ebe2a0795f6e64ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:51.398472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:51.466645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1267/2563] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:51.477394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.479697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:51.485285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:51.538393 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fbfe-eff4-45fb-84f5-32235dac81b4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.542211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.542856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.543155 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.543473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.599758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:51.601205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:51.610480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1297/2564] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:53.403261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.405292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:53.448319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.478243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a658cf-2e03-4825-80ae-5c8c6cfba75b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.484677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.485267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.485551 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.485827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.487631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:53.546175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.547842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275ebb-1d2f-4386-b58e-9999838a508e service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.557632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1268/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:54.130590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.192528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e960-e856-43b8-aa7c-df8295c0bc6b service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.197051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.197915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.198193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.198474 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] PATH_INFO: `/v3/users/3f683d9cd305465d8db00f5bc62472e0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.199692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f683d9cd305465d8db00f5bc62472e0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.201624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.247385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f683d9cd305465d8db00f5bc62472e0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.254657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f683d9cd305465d8db00f5bc62472e0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.259061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.269356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f683d9cd305465d8db00f5bc62472e0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.270023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f683d9cd305465d8db00f5bc62472e0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.277536 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f683d9cd305465d8db00f5bc62472e0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.283451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1298/2566] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:54 2022] DELETE /identity/v3/users/3f683d9cd305465d8db00f5bc62472e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:54.287928 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.288217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.288499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.304958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:54.306131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:54.366145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1269/2567] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:54.376053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.377464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:54.437574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3447b40-a538-4698-8551-e8fa9cb3d5da admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.441209 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.441850 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.442129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.442400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.452440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.453861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.464112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1299/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:50:54.726946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.728500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:54.742058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4d08e-6237-45e1-86ff-b40a4a52e9f9 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.747375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.748875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.749341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.749629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] PATH_INFO: `/v3/projects/095c9c7f562e46dba55561f94afd618d` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.750957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=095c9c7f562e46dba55561f94afd618d)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.753403 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.799951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095c9c7f562e46dba55561f94afd618d', 'request_id': 'req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.805991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095c9c7f562e46dba55561f94afd618d', 'request_id': 'req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.813766 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095c9c7f562e46dba55561f94afd618d', 'request_id': 'req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.820717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.825677 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] The token cache is being invalidate because project 095c9c7f562e46dba55561f94afd618d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:54.825966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.826955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.828787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1270/2569] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:54 2022] DELETE /identity/v3/projects/095c9c7f562e46dba55561f94afd618d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:54.832853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.842428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff62f51-3073-4155-bf54-789b757b0a6c service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.900966 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.901849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.902482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.902482 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] PATH_INFO: `/v3/users/55f0b1c820624a8ebe2a0795f6e64ca0` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.903639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f0b1c820624a8ebe2a0795f6e64ca0)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.905565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.956032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f0b1c820624a8ebe2a0795f6e64ca0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.964097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f0b1c820624a8ebe2a0795f6e64ca0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.977180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f0b1c820624a8ebe2a0795f6e64ca0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.977855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f0b1c820624a8ebe2a0795f6e64ca0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.986170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-13b02743-c005-4531-8d40-af556ca250c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f0b1c820624a8ebe2a0795f6e64ca0'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:54.987785 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.997159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1300/2570] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:50:54 2022] DELETE /identity/v3/users/55f0b1c820624a8ebe2a0795f6e64ca0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:55.290978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.292594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:55.308569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23411ec-2966-4e8b-a876-2b6ea4bb1c9e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.378650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.379576 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.379906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.380182 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] PATH_INFO: `/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.381361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a54fa50bf5843afb17068fe2eafc7c0)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.383327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.428782 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a54fa50bf5843afb17068fe2eafc7c0', 'request_id': 'req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:55.435496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a54fa50bf5843afb17068fe2eafc7c0', 'request_id': 'req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:55.443376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a54fa50bf5843afb17068fe2eafc7c0', 'request_id': 'req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:55.454602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] The token cache is being invalidate because project 6a54fa50bf5843afb17068fe2eafc7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:50:55.454912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:55.455577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-45461b39-1d7e-4842-9d7f-8ae4ec9faf34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:50:55.457176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1271/2571] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:50:55 2022] DELETE /identity/v3/projects/6a54fa50bf5843afb17068fe2eafc7c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:55.462154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.462630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.462821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.481601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:55.483075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:55.540432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1301/2572] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:55.548210 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.548495 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.548767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.567368 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:55.568546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:55.577544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1272/2573] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:55.581843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.592182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0fa5-224b-492c-a269-8c8f34fb8b7a None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.597051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.597741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.598015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.598318 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.599039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.599368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.600972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.612977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1302/2574] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.617334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.627496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0722b2-80e3-42ba-ba9d-642031becd67 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.632300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.632940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.633222 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.633499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.634196 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.636795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.661658 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1273/2575] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:50:55 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:55.665650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.675715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c41c93-892c-4c3f-8e3b-bf0971c523c7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.731806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.732407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.732956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.733234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.733939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.735915 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.755732 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1303/2576] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:50:55 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:55.760631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.771669 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d57d-a7b2-4829-b781-aabea25887c3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.778442 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.779115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.779432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.779708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.780445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.782052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.795601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1274/2577] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:55.799651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.810745 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff437f-7202-4212-9efc-3fc0827134a4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.815495 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.816167 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.816444 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.816716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.817568 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.819243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cf194-6ab0-432f-bf11-6d79c9bb1b5b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.830982 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1304/2578] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:50:55.835243 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.845567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a8eb-5142-4036-89d4-476b3782d6e6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.850150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.851027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.851338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.851614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] PATH_INFO: `/v3/projects/4baf4090fc004b4db65032c208f26ac3/users/a7dd6ed67eae4f6f983cb03261ff96f6/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.866866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baf4090fc004b4db65032c208f26ac3, user_id=a7dd6ed67eae4f6f983cb03261ff96f6, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.870286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.884785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1275/2579] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:50:55 2022] PUT /identity/v3/projects/4baf4090fc004b4db65032c208f26ac3/users/a7dd6ed67eae4f6f983cb03261ff96f6/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:55.895181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.895493 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.895765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.922567 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] MFA Rules not processed for user `a7dd6ed67eae4f6f983cb03261ff96f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:55.923802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:55.979653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.991412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1305/2580] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:50:56.003512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.005306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:56.035244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.065044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011878-ca96-4591-8d0c-ceb01ef9578b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.068653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.069293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.069572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.069841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.078531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.080011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.089885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1276/2581] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:05.988492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.086656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=14 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.824656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.826105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:06.935831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49543066-9bfb-45fe-ba9a-6b0a554668e7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.942879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.944374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.944746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.945037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.947036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:06.968548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.970447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.983650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1306/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:12.440788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.442188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:12.501401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8ff3-3019-41c6-b0c9-337401454abb service glance] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.505102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.505783 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.506063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.506339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.508322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:12.577481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.578923 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.589356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1277/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:15.656628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.658161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:15.673655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d89b6-d277-4a13-8112-09d6b31c0c0b service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.678271 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.679163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.679454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.679735 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] PATH_INFO: `/v3/users/b755c5dbee064673b16b29466f308e1f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.680923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b755c5dbee064673b16b29466f308e1f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:15.683149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:15.730508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b755c5dbee064673b16b29466f308e1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:15.737999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b755c5dbee064673b16b29466f308e1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:15.750161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b755c5dbee064673b16b29466f308e1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:15.750809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b755c5dbee064673b16b29466f308e1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:15.757787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-d76711a6-800a-423e-a485-3e4fc1582041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b755c5dbee064673b16b29466f308e1f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:15.763913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1307/2584] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:15 2022] DELETE /identity/v3/users/b755c5dbee064673b16b29466f308e1f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:15.942972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.953796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df680-4af0-4d67-bea4-7d401d18a4db service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.012907 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.013775 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.014055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.014330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] PATH_INFO: `/v3/projects/959f0811efef434b97dca3bf5fb1a071` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.015564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=959f0811efef434b97dca3bf5fb1a071)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.017489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.063537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959f0811efef434b97dca3bf5fb1a071', 'request_id': 'req-db28ff96-6046-46cd-9782-e8a082af4b71'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:16.065011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.069694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959f0811efef434b97dca3bf5fb1a071', 'request_id': 'req-db28ff96-6046-46cd-9782-e8a082af4b71'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:16.077695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959f0811efef434b97dca3bf5fb1a071', 'request_id': 'req-db28ff96-6046-46cd-9782-e8a082af4b71'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:16.090163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] The token cache is being invalidate because project 959f0811efef434b97dca3bf5fb1a071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:16.090533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:16.091334 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-db28ff96-6046-46cd-9782-e8a082af4b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:16.093142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1278/2585] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:15 2022] DELETE /identity/v3/projects/959f0811efef434b97dca3bf5fb1a071 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:16.097876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.098202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.098507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.117097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:16.118542 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:16.171114 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.182392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1308/2586] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:16.190546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.190773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.191092 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.210079 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:16.211346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:16.220366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1279/2587] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:16.224681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.235211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315340-4a63-49e4-9ed4-5ba334004db6 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.246310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.246310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.246310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.246310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.246693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:16.246693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.246693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.256894 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1309/2588] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:16.261825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.271335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fef6f2-c92a-4c48-a121-967ac8a4d00c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.276741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df36e-0577-4048-b986-102a98459810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.277400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df36e-0577-4048-b986-102a98459810 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.277685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df36e-0577-4048-b986-102a98459810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.277964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df36e-0577-4048-b986-102a98459810 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.278651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df36e-0577-4048-b986-102a98459810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.280638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df36e-0577-4048-b986-102a98459810 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.308781 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1280/2589] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:16.312980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.323197 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149373c-1b58-4072-8305-4b8ab379e0b6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.382832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.383547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.383824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.384099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.384770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.386904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.408113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1310/2590] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:16.412299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df36e-0577-4048-b986-102a98459810 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.423759 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df36e-0577-4048-b986-102a98459810 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.428449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.429121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.429407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.429688 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.430414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.432113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.442630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1281/2591] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:16.446760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.456873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e37a2-7324-421a-b4d5-5fe417f28f39 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.461505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.462165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.462451 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.462733 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.464023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.465620 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9f2a-75d0-4c36-97ff-1b16fa806444 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.475601 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1311/2592] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:16.480359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.490893 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107572d-1c28-4986-a221-b8bf81633227 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.495747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.496625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.496912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.497189 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] PATH_INFO: `/v3/projects/c91a3bd1aec5407e9ea5c55af9d82b94/users/d8d30cd48f4a4c7fab729a5a90d8d5a2/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.513161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91a3bd1aec5407e9ea5c55af9d82b94, user_id=d8d30cd48f4a4c7fab729a5a90d8d5a2, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.515992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.529788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1282/2593] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:16 2022] PUT /identity/v3/projects/c91a3bd1aec5407e9ea5c55af9d82b94/users/d8d30cd48f4a4c7fab729a5a90d8d5a2/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:16.539775 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.540098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.540421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.568969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] MFA Rules not processed for user `d8d30cd48f4a4c7fab729a5a90d8d5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:16.570193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:16.644308 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1312/2594] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:16.656223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.657971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:16.738583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed6038-1512-4d48-b129-00a09bbc6625 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.744647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.745306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.745592 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.745873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.753969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.755719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479ff0-a426-42bd-acb5-1a825a8bd8e7 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.769287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1283/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:51:17.659999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.661420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.713835 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.727126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c60612-3b09-4b72-b6d5-a95bf78f2192 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.731722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.732595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.733153 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.733425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] PATH_INFO: `/v3/users/a7dd6ed67eae4f6f983cb03261ff96f6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.734607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dd6ed67eae4f6f983cb03261ff96f6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.736562 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.781480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dd6ed67eae4f6f983cb03261ff96f6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:17.788443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dd6ed67eae4f6f983cb03261ff96f6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:17.800469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dd6ed67eae4f6f983cb03261ff96f6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:17.801121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dd6ed67eae4f6f983cb03261ff96f6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:17.808178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dd6ed67eae4f6f983cb03261ff96f6'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:17.814062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1313/2596] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:17 2022] DELETE /identity/v3/users/a7dd6ed67eae4f6f983cb03261ff96f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:17.818567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.819038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.819178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.836186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:17.837391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.895806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1284/2597] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:17.905405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.906815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.964492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6d2c9-dd10-4f5c-8912-4c9127fa0df4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.968129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.968768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.969044 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.969314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.978176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.979631 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2483-aad0-4855-af79-721a5245d0da service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.989123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1314/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:18.272674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.274410 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:18.282309 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.294828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c162ca-8b27-45a9-8017-a0fc7f6b0d81 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.309028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.310006 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.310371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.310708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] PATH_INFO: `/v3/projects/4baf4090fc004b4db65032c208f26ac3` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.311962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baf4090fc004b4db65032c208f26ac3)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.313955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.379785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baf4090fc004b4db65032c208f26ac3', 'request_id': 'req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:18.389510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baf4090fc004b4db65032c208f26ac3', 'request_id': 'req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:18.397161 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baf4090fc004b4db65032c208f26ac3', 'request_id': 'req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:18.410945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] The token cache is being invalidate because project 4baf4090fc004b4db65032c208f26ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:18.410945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:18.410945 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:18.416644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1285/2599] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:18 2022] DELETE /identity/v3/projects/4baf4090fc004b4db65032c208f26ac3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:20.746489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.746957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.747070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.765789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:20.767014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:20.833689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1315/2600] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:51:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:20.846835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.848911 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:20.923994 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dcb6c-ff4e-4cfd-bf42-485f46766a0a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.929978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.930791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.931072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.931412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.941298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.942892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.952201 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1286/2601] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:51:22.001704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.003158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.035061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.138660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27c6d4-a6a5-46c9-ae60-fb2332a8747c None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.150029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.151771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.152055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.152333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] PATH_INFO: `/v3/users/d8d30cd48f4a4c7fab729a5a90d8d5a2` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.155904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d30cd48f4a4c7fab729a5a90d8d5a2)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.157860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.251570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d30cd48f4a4c7fab729a5a90d8d5a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.262142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d30cd48f4a4c7fab729a5a90d8d5a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.280855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d30cd48f4a4c7fab729a5a90d8d5a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.282261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d30cd48f4a4c7fab729a5a90d8d5a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.292831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-38da93e8-6482-4230-b624-a73331c4c6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d30cd48f4a4c7fab729a5a90d8d5a2'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.300363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.301855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1316/2602] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:21 2022] DELETE /identity/v3/users/d8d30cd48f4a4c7fab729a5a90d8d5a2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:22.302618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.306552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.307515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.307907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.331014 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:22.333283 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.418812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ef140-06b1-411d-97be-270a0cbf768f service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.432486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.440527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1317/2603] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:22.451813 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.457566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.512636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.513312 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.513595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.513873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.515661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.516165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.532419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.534057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.536022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc9114-ab1e-4830-9d95-e16d8e947149 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.542743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.542743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.543040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.543527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.548254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1287/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:22.561448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.563026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45abc4-3b30-4278-9add-f1c9ec4cda6e service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.574825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1318/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 05:51:22.884449 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.886462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:22.902626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f17b-1670-45b8-834e-3f84e6efdc3d service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.907604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.908419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.908704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.909000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] PATH_INFO: `/v3/projects/c91a3bd1aec5407e9ea5c55af9d82b94` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.910463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91a3bd1aec5407e9ea5c55af9d82b94)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.912427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.975085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91a3bd1aec5407e9ea5c55af9d82b94', 'request_id': 'req-baf766ed-3de9-4cb7-85f3-2b964c8fb312'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.981719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91a3bd1aec5407e9ea5c55af9d82b94', 'request_id': 'req-baf766ed-3de9-4cb7-85f3-2b964c8fb312'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:22.992093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91a3bd1aec5407e9ea5c55af9d82b94', 'request_id': 'req-baf766ed-3de9-4cb7-85f3-2b964c8fb312'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:23.005515 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] The token cache is being invalidate because project c91a3bd1aec5407e9ea5c55af9d82b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:23.005805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:23.006476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-baf766ed-3de9-4cb7-85f3-2b964c8fb312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:23.012378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1288/2606] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:22 2022] DELETE /identity/v3/projects/c91a3bd1aec5407e9ea5c55af9d82b94 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:23.014751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.015245 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.015447 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.035599 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:23.036931 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:23.109957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1319/2607] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:23.111514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.111798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.112077 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.135711 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:23.136934 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:23.145268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1289/2608] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:23.150854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.161398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20230-67c5-44b6-b95b-ba74598483c5 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.166172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.167082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.167483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.168030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.168514 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.168823 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.170516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.184320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1320/2609] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:23.188678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.199791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447510f-5df8-4356-91a1-f4429cf1fb73 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.204697 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.205657 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.206048 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.206674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.207532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.209572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.242769 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1290/2610] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:23.244642 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.259215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc951b7-7a77-438c-ada1-34aad2e67884 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.341067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.342006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.342437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.342856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.343770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.345841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.375468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1321/2611] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:23.379421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.392514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9c16-1263-44bc-bc37-80569989b5c8 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.397767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.398371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.398760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.399174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.400023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.401810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.417407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1291/2612] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:51:23.418528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.434398 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3681-0677-4076-a2ba-5dc20f6cc21d admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.445854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.446919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.448702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.449182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.450105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.452037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eeeea-7519-4eb6-92d0-4c4f6cb5356a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.468831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1322/2613] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:23.470328 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.482510 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e827-93d7-43c9-96ad-752be14711cc admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.487676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.488650 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.488995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.489278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] PATH_INFO: `/v3/projects/d24317cc3137474194285ce0b3030db0/users/4aeffd59acf745229d960e3a8abc3470/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.506119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24317cc3137474194285ce0b3030db0, user_id=4aeffd59acf745229d960e3a8abc3470, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.508828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.525942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1292/2614] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:23 2022] PUT /identity/v3/projects/d24317cc3137474194285ce0b3030db0/users/4aeffd59acf745229d960e3a8abc3470/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:23.531201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3115-d900-423c-a503-0f69c663d278 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.531500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3115-d900-423c-a503-0f69c663d278 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.531783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb3115-d900-423c-a503-0f69c663d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.559513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-dabb3115-d900-423c-a503-0f69c663d278 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:23.560882 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-dabb3115-d900-423c-a503-0f69c663d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:23.614212 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.633165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1323/2615] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:23.643935 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.645803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:23.671536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.725343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a26bc-edb2-4c1d-a019-82485783fbd8 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.730039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.730762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.731050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.731360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.746903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.748480 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.761409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1293/2616] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:24.520226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.520764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.521629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.558217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] MFA Rules not processed for user `4aeffd59acf745229d960e3a8abc3470`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:24.559698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:24.679575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1324/2617] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:24.685123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.705553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3823783-354a-4f8e-9bff-ceb0fc4e3433 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.711451 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.712241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.712604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.713624 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.715599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.727401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.772162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1294/2618] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:24 2022] POST /identity/v3/projects => generated 403 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:24.776605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.788438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8b67-3bb5-40dc-8b29-d265e51593c9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.852937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.853654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.853926 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.854287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.854989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.856951 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.881585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1325/2619] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:24 2022] POST /identity/v3/users => generated 308 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:24.885806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.897940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08246ad-06b5-4cf2-b5f3-06abb7d6fa4a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.903102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.903807 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.904085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.904362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.905086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.907226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.921823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1295/2620] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:24.925810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.942160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4e50-f9da-4d1b-ad1e-93eb394fbfbe admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.947947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.950629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.950790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.951944 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] PATH_INFO: `/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1/users/f66d88a21b2540b587a944cc7d772f59/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.970692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bae05c4cef74363becf8ab1c34eb8f1, user_id=f66d88a21b2540b587a944cc7d772f59, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.973654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.993410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1326/2621] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:24 2022] PUT /identity/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1/users/f66d88a21b2540b587a944cc7d772f59/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:51:24.995432 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.006373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de1074-8e98-4334-8c90-a829599733b2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.084577 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.085353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.085700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.086038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.086826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.088732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda6e2-c50f-4ac9-86ec-82c978c27e1a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.103183 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1296/2622] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:25.109521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.121213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e279ce4-be73-4c47-be7c-e18ed927df95 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.127792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.128617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.128984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.129280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] PATH_INFO: `/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1/users/f66d88a21b2540b587a944cc7d772f59/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.131709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bae05c4cef74363becf8ab1c34eb8f1, user_id=f66d88a21b2540b587a944cc7d772f59, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.134496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.146518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1327/2623] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:25 2022] PUT /identity/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1/users/f66d88a21b2540b587a944cc7d772f59/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:25.958093 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.958788 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.959073 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.001118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] MFA Rules not processed for user `f66d88a21b2540b587a944cc7d772f59`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:26.001996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:26.116455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1297/2624] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:27.669855 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:27.711328 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:27.749644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deda50-0564-43f3-84c3-01350a813b39 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:27.758385 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:27.759330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.759697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.760069 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] PATH_INFO: `/v3/users/4aeffd59acf745229d960e3a8abc3470` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.761348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aeffd59acf745229d960e3a8abc3470)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:27.763319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:27.826467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aeffd59acf745229d960e3a8abc3470'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:27.835660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aeffd59acf745229d960e3a8abc3470'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:27.850623 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aeffd59acf745229d960e3a8abc3470'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:27.851435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aeffd59acf745229d960e3a8abc3470'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:27.859485 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aeffd59acf745229d960e3a8abc3470'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:27.873098 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1328/2625] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:27 2022] DELETE /identity/v3/users/4aeffd59acf745229d960e3a8abc3470 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:28.073709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.098010 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e55d6-cbdf-4daf-a60a-5f775b154f14 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.117954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.198311 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.199801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.200272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.200712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] PATH_INFO: `/v3/projects/d24317cc3137474194285ce0b3030db0` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.202192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24317cc3137474194285ce0b3030db0)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.204350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.280018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24317cc3137474194285ce0b3030db0', 'request_id': 'req-9b8910eb-d0c0-4b22-b558-e86695fdeeff'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.290051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24317cc3137474194285ce0b3030db0', 'request_id': 'req-9b8910eb-d0c0-4b22-b558-e86695fdeeff'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.304022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24317cc3137474194285ce0b3030db0', 'request_id': 'req-9b8910eb-d0c0-4b22-b558-e86695fdeeff'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.323114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] The token cache is being invalidate because project d24317cc3137474194285ce0b3030db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:28.323724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.324746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.327099 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1298/2626] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:28 2022] DELETE /identity/v3/projects/d24317cc3137474194285ce0b3030db0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:28.331619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.333384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:28.360184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e82c9-3384-4a8d-a200-025192f602d7 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.445685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.447742 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.448202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.448657 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] PATH_INFO: `/v3/users/f66d88a21b2540b587a944cc7d772f59` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.450617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66d88a21b2540b587a944cc7d772f59)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.459102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.530751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66d88a21b2540b587a944cc7d772f59'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.536580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.543337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66d88a21b2540b587a944cc7d772f59'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.563314 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66d88a21b2540b587a944cc7d772f59'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.564040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66d88a21b2540b587a944cc7d772f59'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.571416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-15c550c0-de8b-48c3-9195-86eb62036c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66d88a21b2540b587a944cc7d772f59'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.579797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1329/2627] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:28 2022] DELETE /identity/v3/users/f66d88a21b2540b587a944cc7d772f59 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:28.780653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.782224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:28.801491 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8910eb-d0c0-4b22-b558-e86695fdeeff admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.887559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.888444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.888796 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.889185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] PATH_INFO: `/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.890631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bae05c4cef74363becf8ab1c34eb8f1)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.892847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.939884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.950642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bae05c4cef74363becf8ab1c34eb8f1', 'request_id': 'req-33d5ca7e-0a3b-4976-bd1c-9daab8123692'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.958247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bae05c4cef74363becf8ab1c34eb8f1', 'request_id': 'req-33d5ca7e-0a3b-4976-bd1c-9daab8123692'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.972627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bae05c4cef74363becf8ab1c34eb8f1', 'request_id': 'req-33d5ca7e-0a3b-4976-bd1c-9daab8123692'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.988827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] The token cache is being invalidate because project 3bae05c4cef74363becf8ab1c34eb8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:28.989499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.990303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-33d5ca7e-0a3b-4976-bd1c-9daab8123692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:28.992096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1299/2628] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:28 2022] DELETE /identity/v3/projects/3bae05c4cef74363becf8ab1c34eb8f1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:28.997096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.997626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.997626 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.018956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:29.020471 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:29.092013 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1330/2629] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:29.099318 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.100146 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.100640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.122530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:29.123790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:29.133395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1300/2630] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:29.137927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.148504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cef76-8c67-4a4e-977b-1c5461bfbd3e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.153699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.154367 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.154802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.155082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.155843 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.157140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.157817 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.171829 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1331/2631] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.176141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.187372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b24d4-66a5-4293-9e74-09729e97396b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.192284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.192963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.193248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.193529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.194237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.196247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.231370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1301/2632] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:29.235750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.250095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e757-913e-4726-9302-1e5ffb979d98 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.322410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.323249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.323535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.323814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.324520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.326963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.360226 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1332/2633] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:29.364102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.377590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cc5f1-3111-4fda-bf50-41b71dc816f1 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.382493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.383268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.383558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.383836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.384616 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.386456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.399214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1302/2634] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:29.403350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.414319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d64a0-eaf2-428f-a86f-79a1d6aacc1e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.420231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.421091 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.421545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.422000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.422737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.424386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4414492-5f6d-4c14-ac60-9e9026972061 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.439288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1333/2635] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:51:29.440537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.451208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872f364-edb7-4ebb-8349-0617fd641145 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.459178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.460103 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.460389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.460659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] PATH_INFO: `/v3/projects/b8551a902fbc497db377c06a50a126cc/users/7c9c797e99704e5183929f9ed9d8720c/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.479307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8551a902fbc497db377c06a50a126cc, user_id=7c9c797e99704e5183929f9ed9d8720c, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.482322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.510571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1303/2636] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:29 2022] PUT /identity/v3/projects/b8551a902fbc497db377c06a50a126cc/users/7c9c797e99704e5183929f9ed9d8720c/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:29.513064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818762-425e-4614-955c-24bacf48e52d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.513360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818762-425e-4614-955c-24bacf48e52d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.513650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818762-425e-4614-955c-24bacf48e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.550296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-cf818762-425e-4614-955c-24bacf48e52d None None] MFA Rules not processed for user `7c9c797e99704e5183929f9ed9d8720c`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:29.551618 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cf818762-425e-4614-955c-24bacf48e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:29.584596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.659818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1334/2637] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:29.664348 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.739940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948102fe-4d2c-4ab3-866c-cf56edb02726 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.744978 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.745712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.746062 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.746425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.747218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.750338 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.784801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1304/2638] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:29.786032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818762-425e-4614-955c-24bacf48e52d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.801521 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818762-425e-4614-955c-24bacf48e52d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.870607 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.871464 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.871762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.872051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.872758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.874719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.899906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1335/2639] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:29.902184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.913344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b33600-c105-4785-8a5b-c4ef1f2beb34 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.923286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.924122 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.924493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.924830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.925631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.927392 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.947517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1305/2640] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:29.949421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.961130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5b2b-8ba0-40e0-9c4b-0fe8b9305fcd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.967099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.968045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.968347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.968650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] PATH_INFO: `/v3/projects/dac38e659da04e31a8abb8788142add3/users/d2a96f573d4945e5b3eb6a0a17a68ac1/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.987060 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac38e659da04e31a8abb8788142add3, user_id=d2a96f573d4945e5b3eb6a0a17a68ac1, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.989928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.006696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1336/2641] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:29 2022] PUT /identity/v3/projects/dac38e659da04e31a8abb8788142add3/users/d2a96f573d4945e5b3eb6a0a17a68ac1/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:30.011803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.033303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec8aa1-aef1-48e2-9baf-d5c52d9bd211 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.083756 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.111970 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.112774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.113125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.113463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.114291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.116106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6845f-19d6-4b19-a9f4-0bde9dbe86f2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.130754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1306/2642] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:30.135300 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.146152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585fb7-aa11-4964-b4ec-73095384dfdc admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.152194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.153177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.153528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.153880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] PATH_INFO: `/v3/projects/dac38e659da04e31a8abb8788142add3/users/d2a96f573d4945e5b3eb6a0a17a68ac1/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.155952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac38e659da04e31a8abb8788142add3, user_id=d2a96f573d4945e5b3eb6a0a17a68ac1, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.158771 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.170913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1337/2643] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:30 2022] PUT /identity/v3/projects/dac38e659da04e31a8abb8788142add3/users/d2a96f573d4945e5b3eb6a0a17a68ac1/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:30.180830 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.181126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.181430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.209509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] MFA Rules not processed for user `d2a96f573d4945e5b3eb6a0a17a68ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:30.210824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:30.288687 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1307/2644] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:30.300815 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.304749 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:30.370572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6d64-85c3-495e-ac4a-8780c9c432af admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.374243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.374896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.375217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.375500 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.408335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.437667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.439296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.449068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1338/2645] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:30.973809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.975169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:31.035705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c393b7-dcba-47b5-9e70-af2fac8e7a09 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:31.039297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:31.039943 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:31.040227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:31.040504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:31.042537 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:31.052187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:31.053611 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:31.062213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1308/2646] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:31.794763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:31.796205 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:31.813669 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b974d5-acdd-435e-815a-09c98435504e service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:31.817415 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:31.818063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:31.818345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:31.818621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:31.828438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:31.829857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:31.839875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1339/2647] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:34.087805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.096866 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28870f9-b318-4757-989e-718ad0a63fe5 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.100612 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.101344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.101709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.102037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.104037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:34.114035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.115589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.124474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1309/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:34.494996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.496463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:34.592449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120948ea-5b5d-475d-9c6f-88f75f3abc78 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.598522 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.599282 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.599574 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.599866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.601731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:34.621650 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.623288 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96936b4d-9bb0-4224-a715-e43d70b735de service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.634628 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1340/2649] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:35.670857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.722634 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=100 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:35.736399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec499f-58bd-44a2-b4e2-961d2a8a3d14 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.740936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.741841 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.742118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.742393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] PATH_INFO: `/v3/users/7c9c797e99704e5183929f9ed9d8720c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.743621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9c797e99704e5183929f9ed9d8720c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.746212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.790413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9c797e99704e5183929f9ed9d8720c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:35.791216 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9c797e99704e5183929f9ed9d8720c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:35.797436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9c797e99704e5183929f9ed9d8720c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:35.804157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9c797e99704e5183929f9ed9d8720c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:35.816633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9c797e99704e5183929f9ed9d8720c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:35.823787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1310/2650] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:35 2022] DELETE /identity/v3/users/7c9c797e99704e5183929f9ed9d8720c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:35.828302 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.828797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.828901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.847625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:35.848844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:35.908629 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1341/2651] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:35.918862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.920527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:35.979784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f909-247f-4160-9a42-810b78d41b56 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.983753 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.984406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.984686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.984960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.994955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.996405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35746856-b766-44f5-b664-c06d12d154e6 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.006034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1311/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:36.284211 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.285715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.298578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7fada-663e-4d1b-bdc7-c0edb63f6f67 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.303494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.304368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.304649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.304923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] PATH_INFO: `/v3/projects/b8551a902fbc497db377c06a50a126cc` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.306116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8551a902fbc497db377c06a50a126cc)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.308676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.361030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:36.366348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8551a902fbc497db377c06a50a126cc', 'request_id': 'req-488bd924-ac7f-4be3-b242-1ac68164eda5'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.375952 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8551a902fbc497db377c06a50a126cc', 'request_id': 'req-488bd924-ac7f-4be3-b242-1ac68164eda5'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.382311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8551a902fbc497db377c06a50a126cc', 'request_id': 'req-488bd924-ac7f-4be3-b242-1ac68164eda5'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.394614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] The token cache is being invalidate because project b8551a902fbc497db377c06a50a126cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:36.394927 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.395816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.397556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1342/2653] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:36 2022] DELETE /identity/v3/projects/b8551a902fbc497db377c06a50a126cc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:36.401608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.401899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.402048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.402226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.403470 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.420554 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:36.421786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.479276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bd924-ac7f-4be3-b242-1ac68164eda5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.482543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1312/2654] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:36.484844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.485737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.486021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.486324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] PATH_INFO: `/v3/users/d2a96f573d4945e5b3eb6a0a17a68ac1` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.487979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a96f573d4945e5b3eb6a0a17a68ac1)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.490081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.491640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.493020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.513519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:36.538973 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a96f573d4945e5b3eb6a0a17a68ac1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.548336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a96f573d4945e5b3eb6a0a17a68ac1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.562309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a96f573d4945e5b3eb6a0a17a68ac1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.562988 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a96f573d4945e5b3eb6a0a17a68ac1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.567208 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c75df-4ddc-499b-aacb-4eb93f7ac9aa None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.570016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a96f573d4945e5b3eb6a0a17a68ac1'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:36.572915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.573567 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.573854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.574229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.576169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.577483 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1343/2655] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:36 2022] DELETE /identity/v3/users/d2a96f573d4945e5b3eb6a0a17a68ac1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:36.588530 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.590266 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200edaf-9fd3-4c98-98eb-e0d7b478418d service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.599384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1313/2656] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:51:36.901484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.903154 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.013364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.038440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcf8b-57ac-427e-85b2-20e3aa0a8869 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.045079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.046264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.046810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.047345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] PATH_INFO: `/v3/projects/dac38e659da04e31a8abb8788142add3` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.048893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac38e659da04e31a8abb8788142add3)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.051227 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.121552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac38e659da04e31a8abb8788142add3', 'request_id': 'req-8104c436-e8a8-4d52-9785-a2203055963f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:37.130400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac38e659da04e31a8abb8788142add3', 'request_id': 'req-8104c436-e8a8-4d52-9785-a2203055963f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:37.140407 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac38e659da04e31a8abb8788142add3', 'request_id': 'req-8104c436-e8a8-4d52-9785-a2203055963f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:37.159225 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] The token cache is being invalidate because project dac38e659da04e31a8abb8788142add3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:37.160017 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:37.161333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8104c436-e8a8-4d52-9785-a2203055963f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:37.164146 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1344/2657] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:36 2022] DELETE /identity/v3/projects/dac38e659da04e31a8abb8788142add3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:51:37.169509 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.170408 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.170847 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.190302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:37.191418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.260735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1314/2658] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:37.268551 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.268841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.269120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.293402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:37.294930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.307608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1345/2659] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:37.314232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.325459 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72bee-aa17-4cac-9afd-31a21b5b1df2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.330855 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.337494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.358310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1315/2660] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:37.358525 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.368480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ddac-5747-424b-8c47-749cf32e408b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.374330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.375000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.375469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.375800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.376563 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.378488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.406075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1346/2661] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:37.410591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.426845 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d8cbd-fc64-4875-a924-d542c2a95979 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.491999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.492773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.493060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.493380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.495202 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.497455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.522419 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1316/2662] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:37.524661 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.536679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774388cc-3fab-4277-9158-dc966659f420 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.542179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.542875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.543243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.543526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.544259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.545860 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.560408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1347/2663] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:37.564255 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.575645 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bf352-28ec-472d-985f-696120fb6237 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.580910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.581596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.581904 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.582206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.582977 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.587227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68c89-3400-43d0-820e-3c7b77943a32 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.602395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1317/2664] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:37.604518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.617064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1922ce-1614-4aa4-bb97-17242d24508b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.622180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.623070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.623380 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.623655 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] PATH_INFO: `/v3/projects/e9e72a303e5c4e32867d23ed58b74c2c/users/e6579588dbef463c965ab6ca9e961641/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.639748 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e72a303e5c4e32867d23ed58b74c2c, user_id=e6579588dbef463c965ab6ca9e961641, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.642508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.676961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1348/2665] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:37 2022] PUT /identity/v3/projects/e9e72a303e5c4e32867d23ed58b74c2c/users/e6579588dbef463c965ab6ca9e961641/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:37.679268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.679801 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.680159 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.706717 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.710335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] MFA Rules not processed for user `e6579588dbef463c965ab6ca9e961641`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:37.713162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.792953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1318/2666] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:37.797050 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.869710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccda52-a47e-4797-bcd5-3e54e0f2f50e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.875040 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.875737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.876020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.876293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.876999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.878929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.926325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1349/2667] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:37.927165 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.939818 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8818c-dd67-4813-a59b-3936e6ab74f0 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.010857 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.011584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.011869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.012147 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.012881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.014931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.051749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1319/2668] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:38.053589 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.066616 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc38cf-9f7f-46a4-babd-3a39ffb2cd82 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.067652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.075228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.076285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.076870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.077425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.078898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.081078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.096453 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1350/2669] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:38.100264 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.113184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948d107-ec47-480a-9523-3d82743e8235 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.122081 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.122901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.123181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.123575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.124411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.126454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b64c5-92fc-44d1-95b1-c5c6baa130ea admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.141872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1320/2670] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:51:38.145807 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.164110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa34ab-bb87-45f2-a2c7-e36e3e961125 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.170614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.171504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.171793 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.172711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] PATH_INFO: `/v3/projects/727ce501300e40609b37f96ad72f5cf9/users/529fb874bede4460aa7a2e118280c504/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.190080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727ce501300e40609b37f96ad72f5cf9, user_id=529fb874bede4460aa7a2e118280c504, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.192934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.224838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1351/2671] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:38 2022] PUT /identity/v3/projects/727ce501300e40609b37f96ad72f5cf9/users/529fb874bede4460aa7a2e118280c504/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:38.227017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.227460 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.227613 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.256116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] MFA Rules not processed for user `529fb874bede4460aa7a2e118280c504`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:38.257547 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:38.332472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1321/2672] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:38.337059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.404859 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e06c0c-4530-4e9f-b8be-099cb934b4c1 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.409741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.410448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.410729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.411005 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.411744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.413769 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.444790 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1352/2673] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:38.448700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.460906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2404-e7bb-45e3-820e-993f0dc0c44e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.469668 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.539214 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.539981 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.540295 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.541171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.541875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.543869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.566644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1322/2674] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:38.570480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.582559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e6c7d-aeb0-49fa-abb0-a94e5172c0c6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.588202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.588886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.589178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.589434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.590165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.591805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.609438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1353/2675] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:38.610599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.621358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffe658-b715-4b3d-9ee8-ee33824166f9 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.626787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.627902 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.628333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.628948 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] PATH_INFO: `/v3/projects/0a644e6e99f3452d88894b368ec89074/users/b19085e4ba214d5a9e0a54d866f73e8e/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.646523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a644e6e99f3452d88894b368ec89074, user_id=b19085e4ba214d5a9e0a54d866f73e8e, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.649247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.665195 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1323/2676] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:38 2022] PUT /identity/v3/projects/0a644e6e99f3452d88894b368ec89074/users/b19085e4ba214d5a9e0a54d866f73e8e/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:51:38.669914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.681648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a88c-a370-48c6-8f85-db014df2c11c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.751218 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.751892 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.752171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.752452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.753175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.754766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688d3fb-5229-4da5-a6a6-5686f710a65d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.765399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1354/2677] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:38.769833 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.781812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a56fc-486b-49cb-8702-d8c216ff311a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.786811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.787821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.788306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.788653 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] PATH_INFO: `/v3/projects/0a644e6e99f3452d88894b368ec89074/users/b19085e4ba214d5a9e0a54d866f73e8e/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.791385 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a644e6e99f3452d88894b368ec89074, user_id=b19085e4ba214d5a9e0a54d866f73e8e, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.794169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.805798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1324/2678] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:38 2022] PUT /identity/v3/projects/0a644e6e99f3452d88894b368ec89074/users/b19085e4ba214d5a9e0a54d866f73e8e/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:38.817330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.817725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.818342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.848317 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] MFA Rules not processed for user `b19085e4ba214d5a9e0a54d866f73e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:38.849590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:38.881488 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.935580 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1355/2679] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:38.946121 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.948632 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:39.013375 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb874b4-f1ae-4821-a1bc-1bc13ce90c03 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.017355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.018140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.018427 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.018709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.029094 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.030538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.042413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1325/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:39.668386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.669791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:39.683871 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da0be-10e6-40b7-9d7f-11aacfd5ec00 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.688021 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.688755 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.689096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.689310 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.751723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.753466 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.764604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1356/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:43.899937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.909335 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ce5f-5e66-41a9-96a0-543453b5c92f service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.913229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.913884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.914171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.914446 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.976127 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.977512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300343-20ad-41dc-a54a-199311f0b4e6 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.989630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1326/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:46.145872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.207731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b624a-13ac-4a8c-9b40-8e90a97cb8fc service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.212384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.213199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.213480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.213758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] PATH_INFO: `/v3/users/e6579588dbef463c965ab6ca9e961641` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.214947 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6579588dbef463c965ab6ca9e961641)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.216913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.264286 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6579588dbef463c965ab6ca9e961641'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.271350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6579588dbef463c965ab6ca9e961641'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.278402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:46.284677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6579588dbef463c965ab6ca9e961641'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.285971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6579588dbef463c965ab6ca9e961641'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.293837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6579588dbef463c965ab6ca9e961641'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.300002 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1357/2683] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:46 2022] DELETE /identity/v3/users/e6579588dbef463c965ab6ca9e961641 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:46.304517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.305024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.305141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.312434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:46.324101 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:46.325303 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:46.385123 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1327/2684] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:46.395409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.396812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:46.455587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd278-e888-4839-94e0-962b9c3c1ac9 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.459361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.460022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.460315 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.460596 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.470861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.472267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.482531 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1358/2685] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:46.756726 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.758149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:46.772023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbb161-a0b0-49fd-850d-93f430afa61d None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.776960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.777917 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.778263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.778601 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] PATH_INFO: `/v3/projects/e9e72a303e5c4e32867d23ed58b74c2c` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.780020 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e72a303e5c4e32867d23ed58b74c2c)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.782659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.830566 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e72a303e5c4e32867d23ed58b74c2c', 'request_id': 'req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.836706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e72a303e5c4e32867d23ed58b74c2c', 'request_id': 'req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.845967 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e72a303e5c4e32867d23ed58b74c2c', 'request_id': 'req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.856996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] The token cache is being invalidate because project e9e72a303e5c4e32867d23ed58b74c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:46.857286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.858163 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.859725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1328/2686] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:46 2022] DELETE /identity/v3/projects/e9e72a303e5c4e32867d23ed58b74c2c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:46.863864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.874203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1566a-cac8-4c97-a53b-41b28507b0b9 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.929280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.930150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.930434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.930711 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] PATH_INFO: `/v3/users/529fb874bede4460aa7a2e118280c504` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.931922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529fb874bede4460aa7a2e118280c504)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.934356 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.979558 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529fb874bede4460aa7a2e118280c504'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.986934 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529fb874bede4460aa7a2e118280c504'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:46.999565 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529fb874bede4460aa7a2e118280c504'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.000140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529fb874bede4460aa7a2e118280c504'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.006866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529fb874bede4460aa7a2e118280c504'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.013342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1359/2687] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:46 2022] DELETE /identity/v3/users/529fb874bede4460aa7a2e118280c504 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:47.287241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.288686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.303157 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71fa6e-bb9e-4e69-a0cd-61f8eced2f7e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.362468 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.363369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.363648 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.363955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] PATH_INFO: `/v3/projects/727ce501300e40609b37f96ad72f5cf9` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.365131 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] RBAC: Authorizing `identity:delete_project(project_id=727ce501300e40609b37f96ad72f5cf9)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.367040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.400145 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.415454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727ce501300e40609b37f96ad72f5cf9', 'request_id': 'req-59bfa546-44cb-401c-a48c-3401fe61620a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.421474 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727ce501300e40609b37f96ad72f5cf9', 'request_id': 'req-59bfa546-44cb-401c-a48c-3401fe61620a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.428643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727ce501300e40609b37f96ad72f5cf9', 'request_id': 'req-59bfa546-44cb-401c-a48c-3401fe61620a'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.439401 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] The token cache is being invalidate because project 727ce501300e40609b37f96ad72f5cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:47.439686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.440310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.441839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1329/2688] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:47 2022] DELETE /identity/v3/projects/727ce501300e40609b37f96ad72f5cf9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:47.445786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.447261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.456084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.461518 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010f5ba-95eb-45cc-8bbd-31ea7574d047 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.519061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.519957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.520255 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.520508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] PATH_INFO: `/v3/users/b19085e4ba214d5a9e0a54d866f73e8e` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.521676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19085e4ba214d5a9e0a54d866f73e8e)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.523619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.570932 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19085e4ba214d5a9e0a54d866f73e8e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.579773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19085e4ba214d5a9e0a54d866f73e8e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.592102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19085e4ba214d5a9e0a54d866f73e8e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.592734 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19085e4ba214d5a9e0a54d866f73e8e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.599738 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19085e4ba214d5a9e0a54d866f73e8e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:47.605800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1360/2689] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:47 2022] DELETE /identity/v3/users/b19085e4ba214d5a9e0a54d866f73e8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:47.628310 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.629838 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.709525 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa546-44cb-401c-a48c-3401fe61620a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.778825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.779742 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.779985 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.780333 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.782233 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.840174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.845831 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.848211 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1948b2-dc59-4363-837b-9abf2a123e21 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.859339 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1330/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:47.887622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.889160 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.968327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e8f7-8542-47df-8454-57f6d9243b18 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.975833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.977087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.977552 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.978030 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] PATH_INFO: `/v3/projects/0a644e6e99f3452d88894b368ec89074` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.980026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a644e6e99f3452d88894b368ec89074)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.982026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.011929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:48.066910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a644e6e99f3452d88894b368ec89074', 'request_id': 'req-254460a2-302f-4606-a525-12f51344a15a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:48.116995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a644e6e99f3452d88894b368ec89074', 'request_id': 'req-254460a2-302f-4606-a525-12f51344a15a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:48.124719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a644e6e99f3452d88894b368ec89074', 'request_id': 'req-254460a2-302f-4606-a525-12f51344a15a'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:48.137759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] The token cache is being invalidate because project 0a644e6e99f3452d88894b368ec89074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:48.138121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:48.138865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-254460a2-302f-4606-a525-12f51344a15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:48.140802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1361/2691] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:47 2022] DELETE /identity/v3/projects/0a644e6e99f3452d88894b368ec89074 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:48.146826 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.147115 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.147421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.164602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:48.165811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:48.227774 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1331/2692] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:48.237138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.237430 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.237714 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.256055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:48.257324 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:48.265465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1362/2693] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:48.269676 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.280602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2bbf5-b832-4fd0-a191-4a48749f1999 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.285188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.285856 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.286139 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.286412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.287329 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:48.287738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.289533 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.302953 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1332/2694] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:48.308103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.317888 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc197-760a-44d4-925f-3cd59359f2fe None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.322583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.323412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.323698 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.323979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.324673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.326625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.357067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1363/2695] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:48.361579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.371764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6096f-1ec0-46eb-8300-ede5accebf7e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.426496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.427188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.427473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.427748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.428437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.430347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.453873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1333/2696] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:48.455001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.466078 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d733d7-9cf5-46bf-ab72-1a03e6ea7870 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.470684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.471377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.471659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.471933 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.472651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.474231 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.485428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1364/2697] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:51:48.489423 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.500065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3b89-a062-40b4-91e3-5d63f029ce4f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.504864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.505671 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.505965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.506305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.507038 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.508703 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca073-036e-4710-8c2a-b10d430d7979 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.520022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1334/2698] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:48.524203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.534268 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651ca18-817b-4eb7-a8a1-c6fe8e3d05af admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.538913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.539825 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.540102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.540374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] PATH_INFO: `/v3/projects/390738a51a00458492b181236a35a948/users/b0d8eebe734f4cdc8b1b28f7d16c5fc9/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.555837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390738a51a00458492b181236a35a948, user_id=b0d8eebe734f4cdc8b1b28f7d16c5fc9, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.559297 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.573833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1365/2699] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:48 2022] PUT /identity/v3/projects/390738a51a00458492b181236a35a948/users/b0d8eebe734f4cdc8b1b28f7d16c5fc9/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:48.584926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5fd58-5d4a-4dc9-8467-094680c1cec7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.585218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5fd58-5d4a-4dc9-8467-094680c1cec7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.585494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5fd58-5d4a-4dc9-8467-094680c1cec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.613353 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f2f5fd58-5d4a-4dc9-8467-094680c1cec7 None None] MFA Rules not processed for user `b0d8eebe734f4cdc8b1b28f7d16c5fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:48.614550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f2f5fd58-5d4a-4dc9-8467-094680c1cec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:48.661899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:48.681787 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1335/2700] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:48.693821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.695609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:48.752891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48e10-c3cf-4695-83a8-99fa910fb9a4 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.756543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.757194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.757477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.757757 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.766347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.767822 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.776719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1366/2701] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:51.599041 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.599559 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.599665 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.617381 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:51.618574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:51.672098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1336/2702] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:51:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:51.693781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:51.695219 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:51.747935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:51.767716 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd328c6-e6fb-464d-ab6a-c3abed29227b service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:51.773012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:51.773722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.774006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.774285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.783224 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:51.784816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660baf70-3ae6-439b-a1af-9d4fe8a873a0 service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:51.793067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1367/2703] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:51:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:51:51.830942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:51.906112 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bda135-181e-44f0-ba86-ed4420760ffc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:51.911630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:51.912739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.913193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.913712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] PATH_INFO: `/v3/users/b0d8eebe734f4cdc8b1b28f7d16c5fc9` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.915031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d8eebe734f4cdc8b1b28f7d16c5fc9)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:51.917176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:51.969740 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d8eebe734f4cdc8b1b28f7d16c5fc9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:51.970497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d8eebe734f4cdc8b1b28f7d16c5fc9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:51.978002 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d8eebe734f4cdc8b1b28f7d16c5fc9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:51.985864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d8eebe734f4cdc8b1b28f7d16c5fc9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:51.999113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d8eebe734f4cdc8b1b28f7d16c5fc9'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.005727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1337/2704] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:51:51 2022] DELETE /identity/v3/users/b0d8eebe734f4cdc8b1b28f7d16c5fc9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:52.011068 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.011461 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.011746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.030325 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:52.031678 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.097287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1368/2705] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:52.107253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.109128 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.124168 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:52.169844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b951-c4e9-4941-b428-9a4812105e22 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.173502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.174155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.174463 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.174744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.184746 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.186193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a12e-d793-4ddf-a27b-799786bce82b service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.196171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1338/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:51:52.488246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.489849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.515847 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba81d0-39c5-4e67-85d7-7611551a39b0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.521121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.521999 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.522280 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.522554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] PATH_INFO: `/v3/projects/390738a51a00458492b181236a35a948` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.523936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] RBAC: Authorizing `identity:delete_project(project_id=390738a51a00458492b181236a35a948)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.525921 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.574088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390738a51a00458492b181236a35a948', 'request_id': 'req-065d3b62-4a7b-489c-818c-cd0d29c4536b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.580845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390738a51a00458492b181236a35a948', 'request_id': 'req-065d3b62-4a7b-489c-818c-cd0d29c4536b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.586761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390738a51a00458492b181236a35a948', 'request_id': 'req-065d3b62-4a7b-489c-818c-cd0d29c4536b'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.597961 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] The token cache is being invalidate because project 390738a51a00458492b181236a35a948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:51:52.598251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.598885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-065d3b62-4a7b-489c-818c-cd0d29c4536b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:51:52.600432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1369/2707] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:51:52 2022] DELETE /identity/v3/projects/390738a51a00458492b181236a35a948 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:52.606232 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.606695 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.606806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.626363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:52.627608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.687082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1339/2708] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:52.694863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.695377 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.695459 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.715332 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:52.716608 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.724593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1370/2709] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:51:52.729761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.739777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a69a6e-4711-45b0-919f-d447946c134c None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.744512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.745169 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.745454 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.745737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.746462 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:52.746785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.748439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.760699 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1340/2710] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:52.765178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.774504 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031689-9114-49df-8550-d239f79ea1a0 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.780174 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.780827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.781105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.781375 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.782052 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.784025 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.809285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1371/2711] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:51:52 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:52.813371 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.823749 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39deff-aa92-4ef5-832d-3b0133866102 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.879885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.880550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.880832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.881106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.881784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.883735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.904125 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1341/2712] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:51:52 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:52.908382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.919355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4b8fa-da81-44c5-b2f0-c02e0e52929b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.923942 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.924602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.924884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.925158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.925880 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.927505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.938103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1372/2713] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:52.941941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.951837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf69cfa-0983-4c5b-b835-1621b971089e admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.956436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.957089 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.957373 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.957651 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.958366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.959999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e7bae-1e5a-472e-95cd-09ec402b1b4b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.970471 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1342/2714] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:52.974322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.985113 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fddcc-215e-4e86-be69-87d4f20235b9 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.989681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.990548 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.990833 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.991107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] PATH_INFO: `/v3/projects/65c10bac74b94ac5bc2d57f21818e198/users/4431d86464244462b0be573af800295e/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.005731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c10bac74b94ac5bc2d57f21818e198, user_id=4431d86464244462b0be573af800295e, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:53.008399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:53.016975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.021962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1373/2715] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:51:52 2022] PUT /identity/v3/projects/65c10bac74b94ac5bc2d57f21818e198/users/4431d86464244462b0be573af800295e/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:53.032916 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.033203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.033478 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.060705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] MFA Rules not processed for user `4431d86464244462b0be573af800295e`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:53.061884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:53.070672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.128072 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1343/2716] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:51:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:51:53.139663 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:53.141345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:53.199553 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55086d91-c3d8-4b12-a23a-d5c4d6abcadf admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:53.203055 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:53.203722 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.204001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.204275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.212421 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:53.214770 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e963-d337-4e86-9a38-522d5edff862 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:53.229313 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1374/2717] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:03.124633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=22 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.223945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=26 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:22.687517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:22.749186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dae170-a0f2-4480-8649-e8854b11abce None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:22.753689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:22.754552 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.754834 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.755111 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] PATH_INFO: `/v3/users/4431d86464244462b0be573af800295e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:22.756306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4431d86464244462b0be573af800295e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:22.758227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:22.803003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4431d86464244462b0be573af800295e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:22.803681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4431d86464244462b0be573af800295e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:22.811065 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4431d86464244462b0be573af800295e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:22.817858 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4431d86464244462b0be573af800295e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:22.829735 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4431d86464244462b0be573af800295e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:22.835815 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1344/2718] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:52:22 2022] DELETE /identity/v3/users/4431d86464244462b0be573af800295e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:22.840950 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.841458 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.841566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:22.859456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:22.860673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:22.917756 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1375/2719] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:22.927277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:22.928700 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:22.985098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214f1b-65df-46b1-a2ab-08bbf2e46c68 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:22.988767 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:22.989411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.989693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.989969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:22.998998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.000465 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23333ac3-f31e-4c99-9917-4cdb7767c0a9 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.009704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1345/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:23.276728 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.278287 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:23.290298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158331ce-9de8-40ad-bf98-f487a9528762 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.295984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.297079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.297389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.298333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] PATH_INFO: `/v3/projects/65c10bac74b94ac5bc2d57f21818e198` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.299765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c10bac74b94ac5bc2d57f21818e198)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.301819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.352082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c10bac74b94ac5bc2d57f21818e198', 'request_id': 'req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:23.360422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c10bac74b94ac5bc2d57f21818e198', 'request_id': 'req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:23.366039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c10bac74b94ac5bc2d57f21818e198', 'request_id': 'req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:23.377687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] The token cache is being invalidate because project 65c10bac74b94ac5bc2d57f21818e198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:52:23.377974 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:23.378605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-9ff5942f-dd61-41de-9aaf-feb5c7a40e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:23.380186 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1376/2721] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:52:23 2022] DELETE /identity/v3/projects/65c10bac74b94ac5bc2d57f21818e198 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:23.385362 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.385744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.386033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.403689 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:23.404887 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:23.422236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:23.465217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1346/2722] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:23.527559 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.527844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.528122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.546795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:23.548031 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:23.555930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1377/2723] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:23.560172 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.569944 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921791ef-a788-4aba-82fb-4ba33b6e34ab None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.574656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.575342 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.575628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.575906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.576630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:23.576940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.578526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.590426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1347/2724] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:23.594636 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.603935 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba18705-20d2-4534-b6d0-aad92ca3637e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.608904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.609547 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.609830 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.610107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.610803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.612741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.639409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1378/2725] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:52:23 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:23.643622 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.654116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab5b1-6090-4d2b-b970-85cc8ec189cd admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.709983 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.710604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.710848 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.711119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.711863 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.713797 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.734313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1348/2726] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:52:23 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:23.738489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.749564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd891d-753c-4c2c-88ec-9fac4690241f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.754215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.754868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.755179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.755460 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.756182 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.757804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.769868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1379/2727] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:52:23.773785 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.783868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19225-c4e3-442b-ae6f-57b923ad8c9d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.788482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.789136 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.789424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.789704 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.790425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.792563 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775cf62-4e61-4e66-ab8b-ecfb23212cc2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.802416 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1349/2728] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:52:23.806293 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.816866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10437a07-1f39-41cd-8f53-be8bf22a9e93 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.821481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.822361 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.822762 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.823064 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] PATH_INFO: `/v3/projects/1fe6eb06a87c457ebea63095791795f6/users/1e19c778f41f423195ea138699e2a662/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.837473 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe6eb06a87c457ebea63095791795f6, user_id=1e19c778f41f423195ea138699e2a662, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.840243 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.852908 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1380/2729] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:52:23 2022] PUT /identity/v3/projects/1fe6eb06a87c457ebea63095791795f6/users/1e19c778f41f423195ea138699e2a662/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:23.863870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b4c0-ddd6-4882-b032-4d940aeb98e7 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.864162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b4c0-ddd6-4882-b032-4d940aeb98e7 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.864443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8b4c0-ddd6-4882-b032-4d940aeb98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.890989 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-47f8b4c0-ddd6-4882-b032-4d940aeb98e7 None None] MFA Rules not processed for user `1e19c778f41f423195ea138699e2a662`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:23.892227 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-47f8b4c0-ddd6-4882-b032-4d940aeb98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:23.956940 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1350/2730] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:23.967821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.969535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:23.992041 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:24.030978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729b7d-e469-4d85-8628-6249ebed5c7b admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:24.034612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:24.035301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:24.035585 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:24.035865 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:24.044646 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:24.046070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:24.054806 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1381/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:25.393535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:25.394024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:25.394137 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:25.411207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] MFA Rules not processed for user `1e19c778f41f423195ea138699e2a662`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:25.412399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:25.420047 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1351/2732] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:33.189541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:33.190939 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:33.249016 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b751d-b686-4465-893f-77dd88002a43 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:33.252544 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:33.253179 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:33.253456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:33.253730 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:33.255494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:33.318919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:33.320392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:33.330246 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1382/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:35.406080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:36.803032 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:36.804543 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:36.857012 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:36.858799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:36.876832 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc0df-5027-400e-b2be-f95dc0701378 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:36.881803 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:36.882721 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:36.883774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:36.884390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] PATH_INFO: `/v3/users/9a671fbfa3374b288551871a4f4198d8` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:36.887691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a671fbfa3374b288551871a4f4198d8)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:36.890311 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:36.892630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8a070-7754-4be0-8a36-21d2a7817b98 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:36.899885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:36.901242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:36.901741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:36.902086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:36.903959 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:36.917628 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:36.919349 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:36.930574 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1352/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:36.955267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a671fbfa3374b288551871a4f4198d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:36.965575 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a671fbfa3374b288551871a4f4198d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:36.976507 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:36.979080 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a671fbfa3374b288551871a4f4198d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:36.980149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a671fbfa3374b288551871a4f4198d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:36.990643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-525fd3ec-a58e-420d-8282-7a7101abbe17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a671fbfa3374b288551871a4f4198d8'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:36.997242 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1383/2735] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:52:36 2022] DELETE /identity/v3/users/9a671fbfa3374b288551871a4f4198d8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:52:37.178001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.189712 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c77d-f829-4992-b3c2-87c5b07a2c4f service placement] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.249604 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.250425 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.250708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.251017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] PATH_INFO: `/v3/projects/91a7bbc979114407a852d6982073596b` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.252236 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a7bbc979114407a852d6982073596b)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.254142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.301082 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a7bbc979114407a852d6982073596b', 'request_id': 'req-2ab301f1-8ed1-4d95-a7f0-327578736705'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:37.308055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a7bbc979114407a852d6982073596b', 'request_id': 'req-2ab301f1-8ed1-4d95-a7f0-327578736705'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:37.315188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a7bbc979114407a852d6982073596b', 'request_id': 'req-2ab301f1-8ed1-4d95-a7f0-327578736705'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:37.325369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] The token cache is being invalidate because project 91a7bbc979114407a852d6982073596b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:52:37.325656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:37.326291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ab301f1-8ed1-4d95-a7f0-327578736705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:37.327889 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1353/2736] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:52:37 2022] DELETE /identity/v3/projects/91a7bbc979114407a852d6982073596b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:37.332924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d204-9840-432e-a082-419401ff342e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.333296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d204-9840-432e-a082-419401ff342e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.333643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69d204-9840-432e-a082-419401ff342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.352528 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-2a69d204-9840-432e-a082-419401ff342e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:37.354320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2a69d204-9840-432e-a082-419401ff342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:37.413337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1384/2737] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:37.421819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.422114 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.422398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.441142 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:37.442350 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:37.450455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1354/2738] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:37.454494 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69d204-9840-432e-a082-419401ff342e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.464329 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69d204-9840-432e-a082-419401ff342e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.468864 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.469513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.469791 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.470063 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.470779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:37.471084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.472702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.485137 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1385/2739] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:37.489473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.499426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c52c46-2bff-430b-9f1f-5b9d6f934f21 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.504126 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.504725 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.505011 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.505291 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.505974 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.507947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.518242 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:37.536070 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1355/2740] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:37.540641 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.551699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfcf5c-789c-4ed5-ac23-94794887ebb3 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.612394 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.613065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.613369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.613649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.614342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.616305 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.641845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1386/2741] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:37.643033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.654307 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4843c4b-b60b-4240-aa1a-9c931a06ddf6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.658972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.659675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.659957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.660246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.661005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.662589 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.677716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1356/2742] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:52:37.682353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.692382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378d95f-4038-4015-a3d3-80a023d98bc3 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.697767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.698423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.698713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.698993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.699752 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.701364 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8873-bf6c-4234-8e88-15db379f66c4 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.711465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1387/2743] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:52:37.716286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.726105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff9f9-e084-4d21-92e0-f25ae01fb427 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.731384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.732250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.732527 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.732800 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] PATH_INFO: `/v3/projects/c40b4661dace49d8bba2d58a4662e7cd/users/d049be07fca34a2a8579415da9fb6b77/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.747321 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40b4661dace49d8bba2d58a4662e7cd, user_id=d049be07fca34a2a8579415da9fb6b77, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.749960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.762400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1357/2744] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:52:37 2022] PUT /identity/v3/projects/c40b4661dace49d8bba2d58a4662e7cd/users/d049be07fca34a2a8579415da9fb6b77/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:37.767477 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea764f4-77c8-4af3-87d4-bbbe3c50b5b6 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.767789 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea764f4-77c8-4af3-87d4-bbbe3c50b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.768065 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea764f4-77c8-4af3-87d4-bbbe3c50b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.786334 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-eea764f4-77c8-4af3-87d4-bbbe3c50b5b6 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:37.787560 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-eea764f4-77c8-4af3-87d4-bbbe3c50b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:37.831851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:37.848452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1388/2745] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:37.858795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.860493 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:37.918313 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533341d-c841-41c4-87c6-cda5dad9656a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.921971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.922608 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.922888 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.923187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.933675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.935418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.947347 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1358/2746] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:42.475423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a540b-db09-462f-bef0-b2163807b1f7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.475972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a540b-db09-462f-bef0-b2163807b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.475972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a540b-db09-462f-bef0-b2163807b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.507327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1c7a540b-db09-462f-bef0-b2163807b1f7 None None] MFA Rules not processed for user `d049be07fca34a2a8579415da9fb6b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:42.509538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1c7a540b-db09-462f-bef0-b2163807b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:42.583505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1389/2747] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:42.599773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.601257 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:42.689119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8311f9-ae63-4604-a50d-ccd26d1275ab service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:42.696489 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:42.698001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.698517 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.698804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.707674 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:42.714750 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:42.745966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1359/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:42.795401 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c1b2-d0f1-4986-9f17-b5566409b66f None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.795725 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c1b2-d0f1-4986-9f17-b5566409b66f None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.796070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c1b2-d0f1-4986-9f17-b5566409b66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.816664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-adc8c1b2-d0f1-4986-9f17-b5566409b66f None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:42.817877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-adc8c1b2-d0f1-4986-9f17-b5566409b66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:42.896047 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1390/2749] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:52:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:42.912351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.914475 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:42.975573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:43.012992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2b385-b0d9-4403-b94e-b90c4c20bebe service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:43.019063 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:43.019812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.020095 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.020369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.030722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:43.032414 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:43.042386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1360/2750] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:52:43.642084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5825-c311-46e4-a465-18d03e5c7564 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.642584 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5825-c311-46e4-a465-18d03e5c7564 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.642700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a5825-c311-46e4-a465-18d03e5c7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.663527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c12a5825-c311-46e4-a465-18d03e5c7564 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:43.664783 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c12a5825-c311-46e4-a465-18d03e5c7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:43.673319 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1391/2751] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:52:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:43.688678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:43.700476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a3a5-89f1-4e29-a4f6-9a92b975d74c service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:43.706088 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:43.706760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.707046 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.707531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.717411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:43.719022 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:43.729268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1361/2752] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:52:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:52:43.937102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af9a1-6abd-4345-85f9-1dd48f017ece None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.937792 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af9a1-6abd-4345-85f9-1dd48f017ece None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.938234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af9a1-6abd-4345-85f9-1dd48f017ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.956285 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-604af9a1-6abd-4345-85f9-1dd48f017ece None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:43.957747 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-604af9a1-6abd-4345-85f9-1dd48f017ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:43.967151 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1392/2753] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 05:52:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:43.984477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:43.995905 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e819eb-a095-4516-8ccf-14f5248212f8 service swift] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:44.001621 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:44.002354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:44.002820 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:44.003106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:44.012251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:44.013869 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90e43-cace-46d7-be88-8baed9f87226 service swift] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:44.022174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1362/2754] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:52:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:52:44.378994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:44.379399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:44.379989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:44.401995 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] MFA Rules not processed for user `d049be07fca34a2a8579415da9fb6b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:44.406168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:44.410206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:44.410507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:44.410814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:44.414901 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1393/2755] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:44.453016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] MFA Rules not processed for user `5522122a8e3b4d73a6331d90bf06c623`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:44.454440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:44.465341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1363/2756] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:44.481082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:44.498201 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570d02-77b6-438b-8c34-77acad6b4102 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:44.506404 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a7aae669748718cff961b07facc21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:44.507177 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:44.507666 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:44.508126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:44.520001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:44.535489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:44.558362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1394/2757] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 05:52:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:52:44.827315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:44.829033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:44.841553 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fc4f-02c1-4057-a378-94f88ce865e2 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:44.845247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:44.845998 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:44.846289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:44.846724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:44.848721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:44.866356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:44.868444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e707f27-10ff-4455-9027-eaffa600e14c service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:44.879105 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1364/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:46.929983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:46.931751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:46.944811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad81a-f301-4115-a181-1e7a832e7d57 service swift] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:46.949718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:46.950649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:46.951053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:46.951323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] PATH_INFO: `/v3/users/1e19c778f41f423195ea138699e2a662` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:46.952591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e19c778f41f423195ea138699e2a662)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:46.954680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:47.004591 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e19c778f41f423195ea138699e2a662'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.006443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:47.014715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e19c778f41f423195ea138699e2a662'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.027667 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e19c778f41f423195ea138699e2a662'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.028348 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e19c778f41f423195ea138699e2a662'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.035100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e19c778f41f423195ea138699e2a662'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.042408 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1395/2759] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:52:46 2022] DELETE /identity/v3/users/1e19c778f41f423195ea138699e2a662 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:47.046851 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680183bb-6380-43da-9bcb-84290086c05f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:47.047369 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680183bb-6380-43da-9bcb-84290086c05f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:47.047456 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680183bb-6380-43da-9bcb-84290086c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:47.065572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-680183bb-6380-43da-9bcb-84290086c05f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:47.066942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-680183bb-6380-43da-9bcb-84290086c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:47.128042 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1365/2760] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:52:47.139236 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:47.140768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:47.204391 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e1e3-4c8b-490a-a3c3-fc597d2bcf87 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:47.208374 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:47.210051 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:47.210449 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:47.210831 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:47.224776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:47.226264 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:47.239248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1396/2761] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:47.451245 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680183bb-6380-43da-9bcb-84290086c05f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:47.453941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-680183bb-6380-43da-9bcb-84290086c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:47.468270 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680183bb-6380-43da-9bcb-84290086c05f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:47.473106 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:47.474276 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:47.474476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:47.474765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] PATH_INFO: `/v3/projects/1fe6eb06a87c457ebea63095791795f6` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:47.476809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe6eb06a87c457ebea63095791795f6)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:47.479584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:47.531473 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe6eb06a87c457ebea63095791795f6', 'request_id': 'req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.538080 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe6eb06a87c457ebea63095791795f6', 'request_id': 'req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.548494 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe6eb06a87c457ebea63095791795f6', 'request_id': 'req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.560505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] The token cache is being invalidate because project 1fe6eb06a87c457ebea63095791795f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:52:47.560875 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.561591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7c091dd6-48e4-4d9b-887b-c36c4fca18bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:52:47.563355 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1366/2762] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:52:47 2022] DELETE /identity/v3/projects/1fe6eb06a87c457ebea63095791795f6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:55.763193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:55.764681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:55.842639 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc357c-6520-40ce-a029-b74b3a9928b2 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:55.908116 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:55.918099 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:55.919342 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:55.919684 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:55.920685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:55.922001 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:55.934856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:55.936484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:55.948103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1397/2763] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:52:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:57.557444 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:05.942712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:34.644247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97071-f6b3-4fff-ab32-8dc420d68a80 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:53:34.644814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97071-f6b3-4fff-ab32-8dc420d68a80 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:53:34.644979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c97071-f6b3-4fff-ab32-8dc420d68a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:53:34.673602 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-15c97071-f6b3-4fff-ab32-8dc420d68a80 None None] MFA Rules not processed for user `d049be07fca34a2a8579415da9fb6b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:53:34.674808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-15c97071-f6b3-4fff-ab32-8dc420d68a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:53:34.746529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1367/2764] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:53:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:53:35.985963 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:53:35.987439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:53:36.126870 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a3fd7-fc63-431b-8160-24ebc4c7965f service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:53:36.131861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:53:36.132516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:53:36.132797 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:53:36.133074 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:53:36.135422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:53:36.148916 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:53:36.150497 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9a9ea-3b59-4953-952f-0184a6c159cf service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:53:36.161067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1398/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:53:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:53:44.744428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=37 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:46.156741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=63 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:36.186422 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:36.187000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:36.187000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:36.204868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] MFA Rules not processed for user `d049be07fca34a2a8579415da9fb6b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:36.206058 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:36.212962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1368/2766] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:54:46.200150 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:55:34.309331 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:55:34.310390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:55:34.310570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:55:34.328203 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] MFA Rules not processed for user `d049be07fca34a2a8579415da9fb6b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:55:34.329402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:55:34.336337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1399/2767] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:55:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:55:34.374716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:55:34.375946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:55:34.432607 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6ae5d-ff63-4872-816a-45b77700b1cd None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:55:34.436308 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ee6a51a843460ba129d08a6c6fb910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:55:34.436941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:55:34.437223 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:55:34.437502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:55:34.439299 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:55:34.471988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:55:34.473360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:55:34.494263 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1369/2768] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:55:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:55:35.081701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:55:35.083275 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:55:35.163895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289cd8-f8cc-4b23-b499-bfe775503357 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:55:35.167634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:55:35.168463 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:55:35.168633 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:55:35.168914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:55:35.171557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:55:35.185890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:55:35.187527 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:55:35.199513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1400/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:55:44.491693 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=38 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:55:45.194162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=38 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:27.890440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:27.892031 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:27.906805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060a094-4d81-4654-ad3e-ede54e1a50a8 service glance] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:27.913181 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:27.913842 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:27.914129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:27.914482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:27.916286 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:27.929571 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:27.931102 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:27.944176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1370/2770] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:36.196291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:36.198369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:36.293853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e2c8-4dfb-4995-b8d9-c4d40c471c54 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:36.298387 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:36.299336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.299624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.299975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] PATH_INFO: `/v3/users/d049be07fca34a2a8579415da9fb6b77` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.301343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d049be07fca34a2a8579415da9fb6b77)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:36.303336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:36.356582 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd049be07fca34a2a8579415da9fb6b77'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.363697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd049be07fca34a2a8579415da9fb6b77'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.375799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd049be07fca34a2a8579415da9fb6b77'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.376435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd049be07fca34a2a8579415da9fb6b77'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.383572 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b8f4396d-39de-4af8-974c-9a51a1a30816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd049be07fca34a2a8579415da9fb6b77'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.389643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1401/2771] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:56:36 2022] DELETE /identity/v3/users/d049be07fca34a2a8579415da9fb6b77 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:36.564014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:36.576014 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48620f-d07a-4368-98af-e67e78a47a80 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:36.633960 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:36.634825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.635110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.635415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] PATH_INFO: `/v3/projects/c40b4661dace49d8bba2d58a4662e7cd` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.636597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40b4661dace49d8bba2d58a4662e7cd)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:36.638511 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:36.682836 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40b4661dace49d8bba2d58a4662e7cd', 'request_id': 'req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.688849 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40b4661dace49d8bba2d58a4662e7cd', 'request_id': 'req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.696219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40b4661dace49d8bba2d58a4662e7cd', 'request_id': 'req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.707191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] The token cache is being invalidate because project c40b4661dace49d8bba2d58a4662e7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:56:36.707482 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.708116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-eb81fe29-1fa2-49a7-9848-c7c70b2ee3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:36.709654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1371/2772] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:56:36 2022] DELETE /identity/v3/projects/c40b4661dace49d8bba2d58a4662e7cd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:36.714513 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.714802 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.715082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.772662 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:36.773867 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:36.787816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:36.836042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1402/2773] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:36.843915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.844207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.844485 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.864691 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:36.865898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:36.873811 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1372/2774] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:36.877945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:36.887543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddfb2a-7ed9-41bc-836a-8708951ddccf None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:36.892152 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:36.892805 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.893087 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.893369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.894085 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:56:36.894390 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:36.896023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:36.907773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1403/2775] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:56:36.912470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:36.921598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710c6c-ba42-4608-9f57-30a9178046dc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:36.927294 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:36.927937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:36.928217 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:36.928496 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:36.929176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:36.931056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:36.966035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1373/2776] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:36 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:36.970126 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:36.981450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111cf41-541f-4144-b760-664d85be38e9 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.038776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.039476 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.039763 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.040043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.040744 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.042648 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.061955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1404/2777] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:36 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:37.066206 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.076542 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cabe73-9698-44a0-a53a-66d574449493 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.081790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.082516 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.082804 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.083084 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.083843 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.085452 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.098001 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1374/2778] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:37.101900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.112232 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a4fb-f4fb-4268-8dba-486c770efe89 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.117141 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.117776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.118057 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.118336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.119059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.120697 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8785-b4b4-4334-8cba-a41da291d92f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.131229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1405/2779] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:37.135486 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.145930 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35723c-c915-4130-90c0-0c40d3374852 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.150819 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.151737 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.152018 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.152296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] PATH_INFO: `/v3/projects/0df5e59543724280879861167454b307/users/efd1f2e8db874887b8e151837947a230/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.168583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df5e59543724280879861167454b307, user_id=efd1f2e8db874887b8e151837947a230, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.171300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.183747 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1375/2780] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:37 2022] PUT /identity/v3/projects/0df5e59543724280879861167454b307/users/efd1f2e8db874887b8e151837947a230/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:37.194058 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.194353 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.194637 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.220774 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] MFA Rules not processed for user `efd1f2e8db874887b8e151837947a230`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:37.222570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:37.285943 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1406/2781] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:37.290096 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.301920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:37.359814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bbcde-2a86-4a32-b300-87cb017fde5c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.364765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.365426 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.365709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.365984 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.366666 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.368643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.397521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1376/2782] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:37 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:37.398977 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.411758 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647d07-c5c0-4fac-b4b2-15b64008a536 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.423741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:37.471844 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.472519 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.472804 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.473084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.473782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.475743 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.495251 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1407/2783] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:37 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:56:37.499272 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.510075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302dd6-8a58-4733-b403-a24eefba45f6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.514739 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.515431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.515718 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.516000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.516757 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.518359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.529920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1377/2784] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:37.534071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.544173 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b213-5ada-4502-98ce-db8684571b0c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.548712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.549578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.549856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.550347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] PATH_INFO: `/v3/projects/22327a71f5f24f439553bc1724f3328a/users/43bb172b48304a1ba353d1f219d3be20/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.564904 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] RBAC: Authorizing `identity:create_grant(project_id=22327a71f5f24f439553bc1724f3328a, user_id=43bb172b48304a1ba353d1f219d3be20, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.568428 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.581954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1408/2785] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:37 2022] PUT /identity/v3/projects/22327a71f5f24f439553bc1724f3328a/users/43bb172b48304a1ba353d1f219d3be20/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:37.585992 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.596457 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33193f-d63e-4ecb-8eab-a1d5f7b42ffa admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.653076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.653672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.653955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.654230 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.654955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.656590 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe3dc-bcfe-4dd1-b3c2-ec82d3686926 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.666458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1378/2786] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:37.670614 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.681347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeaa71-a4a8-4b5d-ac2b-ac4c0f96dece admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.685898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.686768 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.687045 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.687346 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] PATH_INFO: `/v3/projects/22327a71f5f24f439553bc1724f3328a/users/43bb172b48304a1ba353d1f219d3be20/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.689290 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22327a71f5f24f439553bc1724f3328a, user_id=43bb172b48304a1ba353d1f219d3be20, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.692533 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.702969 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1409/2787] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:37 2022] PUT /identity/v3/projects/22327a71f5f24f439553bc1724f3328a/users/43bb172b48304a1ba353d1f219d3be20/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:37.714287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.714582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.714868 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.741386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] MFA Rules not processed for user `43bb172b48304a1ba353d1f219d3be20`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:37.742599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:37.807927 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:37.811806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1379/2788] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:37.823267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:37.824972 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:37.903354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa1d47-0bff-47a8-8a02-2bf96a09627a admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:37.906884 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:37.907576 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:37.907857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:37.908150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:37.963384 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:37.964853 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:37.973760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1410/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:40.534996 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:40.544870 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b934e-d4c6-45e6-b1a8-3efa272016eb None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:40.548394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:40.549028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:40.549306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:40.549694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:40.559074 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:40.560642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fec62-fbd5-489e-b90c-be29b8e80edd service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:40.571386 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1380/2790] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:47.969625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:50.569188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=6 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:52.962359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:53.023709 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4344e-f0e4-4938-98ac-e1d3f3db978b service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:53.028262 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:53.029157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:53.029439 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:53.029715 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] PATH_INFO: `/v3/users/efd1f2e8db874887b8e151837947a230` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:53.030896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd1f2e8db874887b8e151837947a230)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:53.032838 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:53.086094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd1f2e8db874887b8e151837947a230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.092486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd1f2e8db874887b8e151837947a230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.105103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd1f2e8db874887b8e151837947a230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.105737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd1f2e8db874887b8e151837947a230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.113702 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd1f2e8db874887b8e151837947a230'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.119819 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1411/2791] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:56:52 2022] DELETE /identity/v3/users/efd1f2e8db874887b8e151837947a230 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:53.124400 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:53.124910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:53.125017 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:53.142582 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:53.143827 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:53.202244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1381/2792] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:53.211885 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:53.213272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:53.271577 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e720-edaf-431c-95b4-db90322e7b72 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:53.275102 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:53.275765 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:53.276046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:53.276322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:53.285265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:53.286676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:53.296019 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1412/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:53.567762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:53.569187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:53.581213 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b13e-5531-4d8e-a4a3-ffe57703724e None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:53.586035 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:53.586918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:53.587241 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:53.587523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] PATH_INFO: `/v3/projects/0df5e59543724280879861167454b307` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:53.588723 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df5e59543724280879861167454b307)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:53.590673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:53.637731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df5e59543724280879861167454b307', 'request_id': 'req-6722a564-b653-4cf2-836c-2031349ab42c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.643954 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df5e59543724280879861167454b307', 'request_id': 'req-6722a564-b653-4cf2-836c-2031349ab42c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.650897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df5e59543724280879861167454b307', 'request_id': 'req-6722a564-b653-4cf2-836c-2031349ab42c'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.660941 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] The token cache is being invalidate because project 0df5e59543724280879861167454b307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:56:53.661226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.661837 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.663424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1382/2794] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:56:53 2022] DELETE /identity/v3/projects/0df5e59543724280879861167454b307 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:53.667345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:53.677289 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df138113-0bae-4fad-b6ca-cb22b4f7ed03 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:53.696046 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:53.735811 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:53.737125 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:53.737435 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:53.737712 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] PATH_INFO: `/v3/users/43bb172b48304a1ba353d1f219d3be20` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:53.738891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bb172b48304a1ba353d1f219d3be20)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:53.740866 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:53.784890 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bb172b48304a1ba353d1f219d3be20'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.791782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bb172b48304a1ba353d1f219d3be20'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.804839 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bb172b48304a1ba353d1f219d3be20'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.805511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bb172b48304a1ba353d1f219d3be20'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.812362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-5414a57c-1aab-4e68-9558-db4e021ba0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bb172b48304a1ba353d1f219d3be20'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:53.818786 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1413/2795] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:56:53 2022] DELETE /identity/v3/users/43bb172b48304a1ba353d1f219d3be20 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:54.083915 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.085356 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:54.099158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a564-b653-4cf2-836c-2031349ab42c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.157190 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.158050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.158326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.159140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] PATH_INFO: `/v3/projects/22327a71f5f24f439553bc1724f3328a` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.160627 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22327a71f5f24f439553bc1724f3328a)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.162523 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.192591 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:54.210402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22327a71f5f24f439553bc1724f3328a', 'request_id': 'req-e2a254a8-c24f-485c-993f-3a8661e0cf46'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:54.216573 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22327a71f5f24f439553bc1724f3328a', 'request_id': 'req-e2a254a8-c24f-485c-993f-3a8661e0cf46'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:54.223840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22327a71f5f24f439553bc1724f3328a', 'request_id': 'req-e2a254a8-c24f-485c-993f-3a8661e0cf46'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:54.234252 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] The token cache is being invalidate because project 22327a71f5f24f439553bc1724f3328a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:56:54.234535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:54.235174 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-e2a254a8-c24f-485c-993f-3a8661e0cf46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:54.236824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1383/2796] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:56:54 2022] DELETE /identity/v3/projects/22327a71f5f24f439553bc1724f3328a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:54.241766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.242257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.242382 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.260170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:54.261296 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:54.319412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1414/2797] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:54.326962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.327298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.327584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.348054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:54.349261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:54.357411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1384/2798] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:54.362135 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.372020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7e13-a83a-4d49-b092-d730056880fe None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.376837 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.377764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.378157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.378440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.379298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:56:54.379609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.381215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.394520 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1415/2799] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:56:54.398719 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.408012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc812ffb-d5d7-4b08-88f1-69152f434b7a None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.413823 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.414470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.414748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.415023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.416119 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.418234 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.444267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1385/2800] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:54 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:54.448392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.459109 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d2a69-eda6-4dcf-b3fb-9bc14b3fd53e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.486564 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:54.517625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.518781 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.519062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.519369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.520071 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.521989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.542130 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1416/2801] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:54 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:54.546155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.557000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178ce77-f008-48e9-b68a-ac60721d05c5 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.561744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.562440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.562721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.562999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.563754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.566019 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.577364 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1386/2802] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:54.581761 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.591496 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68345a5e-6425-41a9-b484-a81e3ee08906 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.596110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.596760 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.597042 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.597316 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.598038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.599670 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe29ff1-859a-4447-a01c-58060bd11f0f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.609687 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1417/2803] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:54.613656 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.623764 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a2ee-a686-4ffc-8624-40ff2c197392 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.629037 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.629909 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.630191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.630466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] PATH_INFO: `/v3/projects/5c9cfe9c756b4291a4b88513a93193ec/users/6baee9d2de504784ba59dc3f9bbcb967/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.645532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9cfe9c756b4291a4b88513a93193ec, user_id=6baee9d2de504784ba59dc3f9bbcb967, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.648261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.660999 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1387/2804] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:54 2022] PUT /identity/v3/projects/5c9cfe9c756b4291a4b88513a93193ec/users/6baee9d2de504784ba59dc3f9bbcb967/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:56:54.671170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.671492 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.671773 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.698534 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] MFA Rules not processed for user `6baee9d2de504784ba59dc3f9bbcb967`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:54.699794 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:54.763215 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1418/2805] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:54.774926 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.776647 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:54.833357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5735af-0168-48c2-b72a-f6b86da3efce admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.836969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.837614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.837898 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.838175 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.846557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.848008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf8042-cd12-42ac-9ce4-6dca4d91068b service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.856705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1388/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:54.875656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:54.937267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117e57-1556-4570-8a3d-662b5975ad35 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:54.942799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:54.943699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:54.943984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:54.944259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] PATH_INFO: `/v3/users/6baee9d2de504784ba59dc3f9bbcb967` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:54.945467 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6baee9d2de504784ba59dc3f9bbcb967)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:54.947417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:54.986149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:54.993468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6baee9d2de504784ba59dc3f9bbcb967'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.001038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6baee9d2de504784ba59dc3f9bbcb967'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.013590 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6baee9d2de504784ba59dc3f9bbcb967'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.014239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6baee9d2de504784ba59dc3f9bbcb967'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.021369 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6baee9d2de504784ba59dc3f9bbcb967'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.027163 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1419/2807] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:56:54 2022] DELETE /identity/v3/users/6baee9d2de504784ba59dc3f9bbcb967 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:55.031672 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.031965 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.032250 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.049752 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:55.050987 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:55.099817 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:55.114721 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1389/2808] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:55.124343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.125750 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:55.183818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8fc2-86d7-4a3c-a3cb-2ca344785a2f admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.187489 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.188138 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.188420 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.188699 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.198440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.199900 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097bf3f-cbed-4948-bdf5-1ee4488724aa service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.209654 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1420/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:55.477149 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.478598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:55.492873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639551-d674-4702-bd7a-fe1c2aebb636 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.498000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.498906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.499219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.499505 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] PATH_INFO: `/v3/projects/5c9cfe9c756b4291a4b88513a93193ec` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.500716 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9cfe9c756b4291a4b88513a93193ec)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.503185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.550541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9cfe9c756b4291a4b88513a93193ec', 'request_id': 'req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.556692 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9cfe9c756b4291a4b88513a93193ec', 'request_id': 'req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.563702 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9cfe9c756b4291a4b88513a93193ec', 'request_id': 'req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.574090 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] The token cache is being invalidate because project 5c9cfe9c756b4291a4b88513a93193ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:56:55.574382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.575008 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f997fdd8-33b7-49ce-99f5-f4aa1cfd82b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:56:55.576594 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1390/2810] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:56:55 2022] DELETE /identity/v3/projects/5c9cfe9c756b4291a4b88513a93193ec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:55.581491 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.581957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.582157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.600543 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:55.601737 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:55.660202 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1421/2811] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:55.718895 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.719351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.719706 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.738812 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:55.740056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:55.747957 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1391/2812] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:55.752200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.761912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606611e-ffd2-47c9-a631-c4ef71143d43 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.766538 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.767217 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.767502 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.767778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.769011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:56:55.769309 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.770898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.782333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1422/2813] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:56:55.787185 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.796499 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88866427-1028-4883-a923-28f7d60c15f8 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.801319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.801968 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.802254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.802531 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.803300 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.805193 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.830057 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1392/2814] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:55 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:55.834814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.844824 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7dbeb-060a-4568-845d-67c74467e692 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.891842 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:55.906350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.907026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.907350 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.907635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.908338 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.910355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.930720 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1423/2815] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:55 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:55.934956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.945793 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c264f91-a54b-404f-9c46-1e90e292d9b7 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.950376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.951023 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.951341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.951619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.952337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.953918 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.964411 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1393/2816] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:55.968238 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:55.978092 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758509-e324-46fe-bcd8-df94d43472e6 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:55.982877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:55.983573 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:55.984121 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:55.984413 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:55.985144 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:55.987429 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5048-91ae-46bf-b225-255d3879c8c5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:55.997578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1424/2817] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:56.001492 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.012071 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243210b7-9de3-4e4d-9a7e-b2d3234d4955 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.016694 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.017558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.017840 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.018120 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] PATH_INFO: `/v3/projects/bd13ea7144034591a6c6d3128afbe709/users/8dc5aa1a694c4b5b85969c35de6b2488/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.032619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd13ea7144034591a6c6d3128afbe709, user_id=8dc5aa1a694c4b5b85969c35de6b2488, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.035562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.047738 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1394/2818] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:56 2022] PUT /identity/v3/projects/bd13ea7144034591a6c6d3128afbe709/users/8dc5aa1a694c4b5b85969c35de6b2488/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:56.058213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.058535 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.058816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.085274 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] MFA Rules not processed for user `8dc5aa1a694c4b5b85969c35de6b2488`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:56.086486 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:56.150841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1425/2819] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:56.155394 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.217754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8344c0-9678-4c70-b4e0-05314e542511 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.222570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.223248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.223534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.223814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.224502 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.226397 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.244153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:56.252192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1395/2820] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:56.256498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.267405 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9162-8700-4168-9d02-fb790809a85e None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.323741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.324417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.324706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.324986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.325685 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.327644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.348161 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1426/2821] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:56:56.351910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.362598 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c7b2-af90-48ea-82bc-5c22598a55dd admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.367246 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.367906 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.368192 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.368472 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.369205 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.370803 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.381890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1396/2822] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:56.385686 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.396372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661945-1cc1-4e57-9c61-11bafb9e7f02 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.400984 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.401634 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.401918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.402195 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.402948 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.404612 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd102b8-4275-49de-9bf1-6aaa4de3b850 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.415023 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1427/2823] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:56.419302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.430155 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cff69-fb35-46c7-8f2a-9b28c3c73370 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.434881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.435798 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.436085 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.436366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] PATH_INFO: `/v3/projects/223c5b35aab34aefbf502db5fe6654b3/users/72cf5fbf7b4840fb98de80b14b58af74/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.450680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223c5b35aab34aefbf502db5fe6654b3, user_id=72cf5fbf7b4840fb98de80b14b58af74, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.453370 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.466599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1397/2824] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:56 2022] PUT /identity/v3/projects/223c5b35aab34aefbf502db5fe6654b3/users/72cf5fbf7b4840fb98de80b14b58af74/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:56.477587 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.477878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.478159 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.505272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] MFA Rules not processed for user `72cf5fbf7b4840fb98de80b14b58af74`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:56.506478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:56.526677 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:56.571249 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1428/2825] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:56.575765 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.636809 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157f57b-c12f-4f7b-908a-2378daf0b421 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.641424 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.642075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.642360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.642639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.643854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.645763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.670678 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1398/2826] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:56.675248 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.685914 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2451c9-8785-4f36-bb82-74ba24befb73 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.742006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.742671 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.742954 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.743267 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.743964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.745873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.764945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1429/2827] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:56:56.769806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.779910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96efc0-5e0f-419f-9519-30d291161daf admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.785292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.785946 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.786228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.786504 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.787262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.788892 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.800212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1399/2828] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:56.804183 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.814400 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579652-ab52-473e-8030-5d7ecfb00822 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.819499 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.820372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.820653 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.820930 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] PATH_INFO: `/v3/projects/c507dc1530d540f1ab32055cd8a0f029/users/ab362ba6ea7f4d0882ea29b8259fc5e2/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.836036 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c507dc1530d540f1ab32055cd8a0f029, user_id=ab362ba6ea7f4d0882ea29b8259fc5e2, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.838682 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.851345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1430/2829] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:56 2022] PUT /identity/v3/projects/c507dc1530d540f1ab32055cd8a0f029/users/ab362ba6ea7f4d0882ea29b8259fc5e2/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:56:56.855351 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.865762 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953bba9-3375-4f6a-b473-7a6a4eb296ec admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.921384 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.921980 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.922268 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.922544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.923296 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.925240 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c89a-0867-4a17-a635-e269e875900e admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.934854 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1400/2830] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:56:56.938957 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:56.949937 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918118-021f-4e0a-bdb4-b067bea16d92 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:56.954566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:56.955478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.956643 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.957009 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] PATH_INFO: `/v3/projects/c507dc1530d540f1ab32055cd8a0f029/users/ab362ba6ea7f4d0882ea29b8259fc5e2/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:56.958994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c507dc1530d540f1ab32055cd8a0f029, user_id=ab362ba6ea7f4d0882ea29b8259fc5e2, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:56.961676 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:56.972054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1431/2831] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:56:56 2022] PUT /identity/v3/projects/c507dc1530d540f1ab32055cd8a0f029/users/ab362ba6ea7f4d0882ea29b8259fc5e2/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:56:56.983372 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:56.983659 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:56.984207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:57.010481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] MFA Rules not processed for user `ab362ba6ea7f4d0882ea29b8259fc5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:56:57.011722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:57.032040 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:57.081629 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1401/2832] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:56:57.092887 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:57.094652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:57.153691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049c9f1-5800-4793-a0fc-89507087e9cd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:57.157335 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:57.157975 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:57.158257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:57.158541 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:57.187753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:56:57.216635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:57.218075 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:57.227181 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1432/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:58.701107 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:58.702597 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:56:58.715285 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273357f6-6f7d-416f-869d-cdbc5549003f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:58.718763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:58.719431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:58.719713 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:58.719988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:58.776470 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:58.777913 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:58.787942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1402/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:56:59.303448 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:56:59.312082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90126-25ea-4554-80a5-95e5832b2c08 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:56:59.315692 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:56:59.316333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:56:59.316619 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:56:59.316893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:56:59.325795 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:56:59.327252 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389858-1293-4b94-9109-2b867677e8e4 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:56:59.336928 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1433/2835] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:56:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:03.157436 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:03.218789 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250e560-41cc-4e20-b57f-2cf542733d15 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:03.223507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:03.224376 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:03.224663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:03.224936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] PATH_INFO: `/v3/users/8dc5aa1a694c4b5b85969c35de6b2488` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:03.226166 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc5aa1a694c4b5b85969c35de6b2488)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:03.228140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:03.273640 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc5aa1a694c4b5b85969c35de6b2488'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.274290 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc5aa1a694c4b5b85969c35de6b2488'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.281187 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc5aa1a694c4b5b85969c35de6b2488'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.286154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:03.290171 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc5aa1a694c4b5b85969c35de6b2488'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.304184 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc5aa1a694c4b5b85969c35de6b2488'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.310154 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1403/2836] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:03 2022] DELETE /identity/v3/users/8dc5aa1a694c4b5b85969c35de6b2488 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:03.314656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:03.315810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:03.316037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:03.333600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:03.334821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:03.394680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1434/2837] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:57:03.404297 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:03.405709 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:03.462914 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809cf6c-76a8-4d55-a8f4-b33b6922e5c2 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:03.466557 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:03.467225 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:03.467512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:03.467791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:03.476790 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:03.478207 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:03.488366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1404/2838] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:03.750987 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:03.752891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:03.765084 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffba86-ad74-4d1c-9d2a-d9c0a099b99d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:03.769938 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:03.770886 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:03.771273 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:03.771651 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] PATH_INFO: `/v3/projects/bd13ea7144034591a6c6d3128afbe709` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:03.772922 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd13ea7144034591a6c6d3128afbe709)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:03.775088 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:03.823059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd13ea7144034591a6c6d3128afbe709', 'request_id': 'req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.829985 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd13ea7144034591a6c6d3128afbe709', 'request_id': 'req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.835962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd13ea7144034591a6c6d3128afbe709', 'request_id': 'req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.848110 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] The token cache is being invalidate because project bd13ea7144034591a6c6d3128afbe709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:03.848392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.849037 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.850557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1435/2839] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:03 2022] DELETE /identity/v3/projects/bd13ea7144034591a6c6d3128afbe709 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:03.854481 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:03.865260 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3a59-3d88-4f7d-a77a-c6d4f058f245 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:03.919899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:03.920696 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:03.920979 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:03.921254 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] PATH_INFO: `/v3/users/72cf5fbf7b4840fb98de80b14b58af74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:03.922562 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cf5fbf7b4840fb98de80b14b58af74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:03.925302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:03.970113 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cf5fbf7b4840fb98de80b14b58af74'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.970748 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cf5fbf7b4840fb98de80b14b58af74'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.979283 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cf5fbf7b4840fb98de80b14b58af74'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.986409 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cf5fbf7b4840fb98de80b14b58af74'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.998124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cf5fbf7b4840fb98de80b14b58af74'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:03.999546 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:04.004969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1405/2840] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:03 2022] DELETE /identity/v3/users/72cf5fbf7b4840fb98de80b14b58af74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:04.279854 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:04.281422 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:04.296053 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c05ac-3c22-4cf2-bd10-93acf9a39f4e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:04.338841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:04.358718 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:04.359878 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:04.360158 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:04.360433 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] PATH_INFO: `/v3/projects/223c5b35aab34aefbf502db5fe6654b3` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:04.361644 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=223c5b35aab34aefbf502db5fe6654b3)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:04.363688 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:04.411097 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223c5b35aab34aefbf502db5fe6654b3', 'request_id': 'req-0f41edca-2477-4039-a444-d7b80659a52e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.418343 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223c5b35aab34aefbf502db5fe6654b3', 'request_id': 'req-0f41edca-2477-4039-a444-d7b80659a52e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.424142 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223c5b35aab34aefbf502db5fe6654b3', 'request_id': 'req-0f41edca-2477-4039-a444-d7b80659a52e'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.434907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] The token cache is being invalidate because project 223c5b35aab34aefbf502db5fe6654b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:04.435216 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.435841 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.437378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1436/2841] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:04 2022] DELETE /identity/v3/projects/223c5b35aab34aefbf502db5fe6654b3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:04.442412 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:04.443846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:04.457344 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6e21a-acc9-458c-8a32-b1ebc26a884f admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:04.512186 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:04.513056 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:04.513341 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:04.513618 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] PATH_INFO: `/v3/users/ab362ba6ea7f4d0882ea29b8259fc5e2` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:04.514792 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab362ba6ea7f4d0882ea29b8259fc5e2)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:04.516770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:04.561500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab362ba6ea7f4d0882ea29b8259fc5e2'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.562135 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab362ba6ea7f4d0882ea29b8259fc5e2'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.569754 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab362ba6ea7f4d0882ea29b8259fc5e2'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.576518 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab362ba6ea7f4d0882ea29b8259fc5e2'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.588705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-3a13ee06-8d1e-4166-8d52-6b360a864493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab362ba6ea7f4d0882ea29b8259fc5e2'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.594512 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1406/2842] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:04 2022] DELETE /identity/v3/users/ab362ba6ea7f4d0882ea29b8259fc5e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:04.864689 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:04.866107 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:04.879373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41edca-2477-4039-a444-d7b80659a52e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:04.937409 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:04.938270 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:04.938545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:04.938816 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] PATH_INFO: `/v3/projects/c507dc1530d540f1ab32055cd8a0f029` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:04.940026 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c507dc1530d540f1ab32055cd8a0f029)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:04.941924 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:04.986828 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c507dc1530d540f1ab32055cd8a0f029', 'request_id': 'req-f76b9b4c-f759-4e96-8cc2-f698949612ab'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.994072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c507dc1530d540f1ab32055cd8a0f029', 'request_id': 'req-f76b9b4c-f759-4e96-8cc2-f698949612ab'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:04.999710 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c507dc1530d540f1ab32055cd8a0f029', 'request_id': 'req-f76b9b4c-f759-4e96-8cc2-f698949612ab'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:05.007624 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:05.012043 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] The token cache is being invalidate because project c507dc1530d540f1ab32055cd8a0f029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:05.012681 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:05.013410 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-f76b9b4c-f759-4e96-8cc2-f698949612ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:05.015341 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1437/2843] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:04 2022] DELETE /identity/v3/projects/c507dc1530d540f1ab32055cd8a0f029 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:05.020760 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.021052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.021406 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.041871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:05.043054 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:05.229162 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1407/2844] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:05.237170 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.237593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.237873 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.256061 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:05.257184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:05.264955 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1438/2845] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:05.269743 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.279439 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711aa9-11a6-4577-b528-f47dd0046b1b None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.284076 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.284724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.285003 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.285277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.285995 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86779) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:57:05.286319 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.287936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.299317 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1408/2846] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:57:05.303425 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.312468 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d83c-b232-4324-bb03-b3574d2075f8 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.317812 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.318452 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.318731 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.319006 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.319983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.322131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.348550 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1439/2847] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:05.352675 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.360078 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:05.363558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3f80-3dd3-4c0f-9658-a099021bfde3 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.420476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.421141 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.421431 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.421707 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.422399 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.424844 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.444832 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1409/2848] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:05.449032 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.459481 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe963c2-772e-47f6-8ed4-6ce15a73e872 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.464054 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.464701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.464983 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.465261 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.465978 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.467603 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.478011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1440/2849] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:05.481876 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.492846 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90b160-d02f-4a47-b117-5d5d9cc05b72 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.497548 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.498220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.498484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.498761 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.499521 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.501100 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a4a3-2467-4133-8224-4fb1cd2681e1 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.511682 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1410/2850] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:05.515592 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.525298 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba14c-7993-4305-99ee-c5e70bb3d9d5 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.529919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.530787 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.531067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.531373 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] PATH_INFO: `/v3/projects/223984f57229457cb2a0707d029a02e0/users/2790397850894110ac4a470c2c83c26f/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.545484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223984f57229457cb2a0707d029a02e0, user_id=2790397850894110ac4a470c2c83c26f, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.548168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.562259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1441/2851] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:05 2022] PUT /identity/v3/projects/223984f57229457cb2a0707d029a02e0/users/2790397850894110ac4a470c2c83c26f/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:57:05.574052 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.574345 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.574626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.600322 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] MFA Rules not processed for user `2790397850894110ac4a470c2c83c26f`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:05.601522 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:05.664458 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1411/2852] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:05.668994 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.728919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517126eb-3e1e-4170-8766-fee9b04b3c73 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.733511 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.734416 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.734696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.734968 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.735696 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.738103 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.762545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1442/2853] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:05.766705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.777532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77bc1-aaa9-452c-80d6-77843cccfb49 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.832327 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.832988 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.833267 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.833541 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.834215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.836156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.856464 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1412/2854] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:05.860706 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.872081 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94b266-386d-4b0c-a786-f22857e08c3c admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.876693 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.877378 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.877659 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.877929 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.878645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.880272 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.890788 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1443/2855] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:05.894912 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.900026 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:05.906104 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d46a4e-9a8c-479c-b9b2-663200bf3e3b admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.911873 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.912540 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.912824 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.913097 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.913816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.915434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70cb6a-0305-46f8-8f05-c425571955b7 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.925956 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1413/2856] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:05.930206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:05.940015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074aab9-795a-4c24-a095-be4f5f0e8893 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:05.944753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:05.945635 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.945918 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.946200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] PATH_INFO: `/v3/projects/530bac20e6ec4259ad14a87c64250524/users/9de5a8b7dec94bae958150b997a64d94/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:05.960740 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] RBAC: Authorizing `identity:create_grant(project_id=530bac20e6ec4259ad14a87c64250524, user_id=9de5a8b7dec94bae958150b997a64d94, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:05.963438 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:05.976557 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1444/2857] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:05 2022] PUT /identity/v3/projects/530bac20e6ec4259ad14a87c64250524/users/9de5a8b7dec94bae958150b997a64d94/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:05.987614 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:05.987899 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:05.988180 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.013498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] MFA Rules not processed for user `9de5a8b7dec94bae958150b997a64d94`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:06.014639 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:06.078359 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1414/2858] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:06.082898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.131015 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:06.146172 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137403-d9c6-455b-ab21-b5b81852482d admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.151122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.151902 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.152199 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.152487 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] PATH_INFO: `/v3/projects` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.153178 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.155096 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.181000 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1445/2859] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:57:06.185024 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.195630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6b76c-4cfc-485c-9348-4d54406b80e0 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.250500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.251239 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.251526 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.251805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] PATH_INFO: `/v3/users` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.252644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.254575 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.274476 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1415/2860] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:57:06 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:06.278397 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.289621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463ff75-3d40-4eaf-9009-5237054f1706 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.294266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.294919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.295229 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.295508 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.296258 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.297875 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.308799 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1446/2861] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:06.313051 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.323004 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf134a-2d93-4774-9467-78a2026d0e1c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.327802 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.328681 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.328958 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.329229 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] PATH_INFO: `/v3/projects/8f278f44dce5425a9df4d10aa23b16f7/users/a842a8866b5f4a42aa34daa01e657648/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.344708 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f278f44dce5425a9df4d10aa23b16f7, user_id=a842a8866b5f4a42aa34daa01e657648, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.348277 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.361402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1416/2862] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:06 2022] PUT /identity/v3/projects/8f278f44dce5425a9df4d10aa23b16f7/users/a842a8866b5f4a42aa34daa01e657648/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:06.365713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.375586 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d82ae-a41b-44df-8559-ac4c50c1cb01 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.432753 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.433323 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.433602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.433879 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.434605 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.436265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1249ea-a0a3-4bf2-a2c1-ed570a3a31f9 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.446777 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1447/2863] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:57:06.450806 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.461919 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ad612-e79c-4538-b0c9-5d5478fc7a25 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.466558 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.467477 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.467768 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.468039 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] PATH_INFO: `/v3/projects/8f278f44dce5425a9df4d10aa23b16f7/users/a842a8866b5f4a42aa34daa01e657648/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.470025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f278f44dce5425a9df4d10aa23b16f7, user_id=a842a8866b5f4a42aa34daa01e657648, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.473519 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.484129 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1417/2864] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:06 2022] PUT /identity/v3/projects/8f278f44dce5425a9df4d10aa23b16f7/users/a842a8866b5f4a42aa34daa01e657648/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:06.494454 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.494767 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.495048 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.521895 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] MFA Rules not processed for user `a842a8866b5f4a42aa34daa01e657648`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:06.523095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:06.591515 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1448/2865] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:06.602871 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:06.604623 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:06.639585 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:06.663786 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8fab-91d4-4876-92c5-e19b45bd4b5a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:06.667434 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:06.668075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:06.668358 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:06.668631 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:06.724455 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:06.725881 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:06.734862 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1418/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:08.223443 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:08.224778 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:08.237059 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1782aa3-e561-4323-9f6f-d9824a150bb7 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:08.240593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:08.241266 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:08.241546 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:08.241821 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:08.282340 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:08.299800 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:08.301234 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:08.310039 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1449/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:08.802864 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:08.811538 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31a939-9caa-485a-98df-4551558f1b32 service cinder] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:08.815773 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e060788d6f54f4d9fcbccdb720c3500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:08.816413 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:08.816727 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:08.817005 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:08.826098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:08.827565 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259c935-7cb8-4f9b-8c68-65f0adb2bfef service cinder] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:08.837507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1419/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:12.657386 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:12.718190 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b19ec-fbf1-4f5e-bab6-ad62d362c6f9 service cinder] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:12.722956 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:12.723861 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:12.724149 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:12.724431 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] PATH_INFO: `/v3/users/2790397850894110ac4a470c2c83c26f` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:12.725609 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2790397850894110ac4a470c2c83c26f)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:12.727570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:12.773307 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2790397850894110ac4a470c2c83c26f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:12.780417 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2790397850894110ac4a470c2c83c26f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:12.792505 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2790397850894110ac4a470c2c83c26f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:12.793165 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2790397850894110ac4a470c2c83c26f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:12.800259 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2790397850894110ac4a470c2c83c26f'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:12.806150 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1450/2869] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:12 2022] DELETE /identity/v3/users/2790397850894110ac4a470c2c83c26f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:12.810584 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:12.811067 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:12.811212 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:12.828118 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:12.829298 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:12.886816 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1420/2870] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:12.896991 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:12.898392 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:12.955194 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3120-5b26-439c-8139-e50471e30dbd admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:12.958891 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:12.959570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:12.959852 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:12.960129 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:12.969105 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:12.970579 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:12.980100 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1451/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:13.254383 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:13.255973 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:13.268361 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06644eb0-08b6-48e8-bab1-8e484aa6216f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:13.273000 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:13.273872 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:13.274153 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:13.274430 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] PATH_INFO: `/v3/projects/223984f57229457cb2a0707d029a02e0` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:13.275654 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223984f57229457cb2a0707d029a02e0)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:13.277569 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:13.323972 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223984f57229457cb2a0707d029a02e0', 'request_id': 'req-d2ac785b-054b-4dde-8f14-00d02f1ded31'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.330235 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223984f57229457cb2a0707d029a02e0', 'request_id': 'req-d2ac785b-054b-4dde-8f14-00d02f1ded31'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.338890 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223984f57229457cb2a0707d029a02e0', 'request_id': 'req-d2ac785b-054b-4dde-8f14-00d02f1ded31'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.345357 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:13.350962 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] The token cache is being invalidate because project 223984f57229457cb2a0707d029a02e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:13.351539 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.352288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.354389 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1421/2872] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:13 2022] DELETE /identity/v3/projects/223984f57229457cb2a0707d029a02e0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:13.358354 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:13.363766 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:13.370336 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3fe6-8b3c-46eb-9e5e-855c36ae2580 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:13.429067 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:13.429857 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:13.430147 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:13.430426 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] PATH_INFO: `/v3/users/9de5a8b7dec94bae958150b997a64d94` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:13.431679 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de5a8b7dec94bae958150b997a64d94)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:13.433673 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:13.478993 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de5a8b7dec94bae958150b997a64d94'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.486322 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de5a8b7dec94bae958150b997a64d94'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.499545 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de5a8b7dec94bae958150b997a64d94'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.500198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de5a8b7dec94bae958150b997a64d94'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.507022 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de5a8b7dec94bae958150b997a64d94'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.512907 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1452/2873] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:13 2022] DELETE /identity/v3/users/9de5a8b7dec94bae958150b997a64d94 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:13.773124 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:13.774626 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:13.788380 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac785b-054b-4dde-8f14-00d02f1ded31 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:13.847715 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:13.848587 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:13.848877 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:13.849156 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] PATH_INFO: `/v3/projects/530bac20e6ec4259ad14a87c64250524` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:13.850346 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=530bac20e6ec4259ad14a87c64250524)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:13.852343 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:13.897894 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530bac20e6ec4259ad14a87c64250524', 'request_id': 'req-2ad8bc91-1e21-424a-9e48-c70181542f7d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.903884 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530bac20e6ec4259ad14a87c64250524', 'request_id': 'req-2ad8bc91-1e21-424a-9e48-c70181542f7d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.911897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530bac20e6ec4259ad14a87c64250524', 'request_id': 'req-2ad8bc91-1e21-424a-9e48-c70181542f7d'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.922237 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] The token cache is being invalidate because project 530bac20e6ec4259ad14a87c64250524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:13.922529 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.923224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:13.925391 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1422/2874] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:13 2022] DELETE /identity/v3/projects/530bac20e6ec4259ad14a87c64250524 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:13.929344 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:13.930751 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:13.944556 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2982-1955-49e2-a84a-0f8c572c5c24 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.000349 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.001148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.001432 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.001719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] PATH_INFO: `/v3/users/a842a8866b5f4a42aa34daa01e657648` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.003604 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a842a8866b5f4a42aa34daa01e657648)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.005532 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.028372 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:14.052498 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a842a8866b5f4a42aa34daa01e657648'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.059524 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a842a8866b5f4a42aa34daa01e657648'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.071827 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a842a8866b5f4a42aa34daa01e657648'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.072455 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a842a8866b5f4a42aa34daa01e657648'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.079221 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-ebac3325-06b4-455d-b8f7-19ef3d82a057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a842a8866b5f4a42aa34daa01e657648'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.085713 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1453/2875] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 05:57:13 2022] DELETE /identity/v3/users/a842a8866b5f4a42aa34daa01e657648 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:14.360352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.362513 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:14.382599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8bc91-1e21-424a-9e48-c70181542f7d admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.439814 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.440683 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.440971 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.441251 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] PATH_INFO: `/v3/projects/8f278f44dce5425a9df4d10aa23b16f7` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.442437 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f278f44dce5425a9df4d10aa23b16f7)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.444398 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.477966 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:14.492770 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f278f44dce5425a9df4d10aa23b16f7', 'request_id': 'req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.498825 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f278f44dce5425a9df4d10aa23b16f7', 'request_id': 'req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.505942 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f278f44dce5425a9df4d10aa23b16f7', 'request_id': 'req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.516044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] The token cache is being invalidate because project 8f278f44dce5425a9df4d10aa23b16f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86779) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 05:57:14.516330 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.516947 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-f216a8b9-5d5c-4efb-8b86-cdf9cce5fb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 05:57:14.519203 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1423/2876] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 05:57:14 2022] DELETE /identity/v3/projects/8f278f44dce5425a9df4d10aa23b16f7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:14.524122 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.524423 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.524705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.543079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:14.544230 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:14.602695 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1454/2877] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:14.610596 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.610885 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.611191 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.629287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:14.630497 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:14.638428 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1424/2878] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:14.643184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.653038 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42436c-2da8-4b85-ab5d-e7f77eabc93d None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.657683 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.658906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.659257 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.659625 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.660347 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:57:14.660656 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.662276 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.673700 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1455/2879] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 25 05:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:57:14.678483 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.687636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a7b71-7a89-4102-bdb1-cdcdb8c5b8bc None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.693030 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.693680 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.693964 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.694244 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.694925 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.696859 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.721287 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1425/2880] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:57:14 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:14.725399 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.735622 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfc2a3-f67f-4ac5-bddf-49f370c897f8 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.793691 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.794291 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.794578 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.794858 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.795595 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.797516 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.817814 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1456/2881] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:57:14 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:14.821931 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.833284 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4bf6-491c-4b74-971b-ae1938a3eab9 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.837936 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.838642 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.838921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.839226 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.839951 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.841532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.852534 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1426/2882] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:14.856569 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.866981 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c294-66dc-4bb4-8aa9-23c630ab057e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.871680 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.872333 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.872617 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.872896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.873621 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.875237 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e784c-b0e5-4b2e-a22d-d1c323ea72dc admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.885845 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1457/2883] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:57:14.889891 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:14.900363 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b87a6-975e-4edd-bfaf-4b687f55908a admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:14.904897 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:14.905763 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] REQUEST_METHOD: `PUT` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.906044 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.906326 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] PATH_INFO: `/v3/projects/ad09eb68f3f04c89bd1fd9d60583edb6/users/5826fea6410645609a2fac7ce8376c1e/roles/0c3b8416418f4545a6c4598e12e222eb` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.920685 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad09eb68f3f04c89bd1fd9d60583edb6, user_id=5826fea6410645609a2fac7ce8376c1e, role_id=0c3b8416418f4545a6c4598e12e222eb)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:14.923352 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:14.936619 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1427/2884] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:14 2022] PUT /identity/v3/projects/ad09eb68f3f04c89bd1fd9d60583edb6/users/5826fea6410645609a2fac7ce8376c1e/roles/0c3b8416418f4545a6c4598e12e222eb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:14.942776 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c630a4-9ca3-47a8-ba86-4c20d7da2ccb None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:14.943269 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c630a4-9ca3-47a8-ba86-4c20d7da2ccb None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:14.943368 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c630a4-9ca3-47a8-ba86-4c20d7da2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:14.956320 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:14.962228 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-a4c630a4-9ca3-47a8-ba86-4c20d7da2ccb None None] MFA Rules not processed for user `07b3e7435f2b475f9f928da267cae759`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:14.964027 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-a4c630a4-9ca3-47a8-ba86-4c20d7da2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:15.022979 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1458/2885] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:15.032722 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:15.034673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:15.090440 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba314d-b2f2-4afc-a374-7323eccc824c admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:15.094033 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:15.094670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:15.094952 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:15.095288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:15.104382 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:15.105828 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:15.115498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1428/2886] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:19.080630 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.081095 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.081180 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.110600 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] MFA Rules not processed for user `5826fea6410645609a2fac7ce8376c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:19.112779 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:19.182649 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1459/2887] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:19.186883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.197963 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4828-30b4-4cb6-87f3-609f08c81f2e service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.202791 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.203564 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.203939 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.204292 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] PATH_INFO: `/v3/projects` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.205068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.207045 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.234579 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1429/2888] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 25 05:57:19 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:19.238849 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.250148 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbd36-d94a-4656-a61c-83ab4346f0a9 None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.309923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.310613 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.310898 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.311214 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] PATH_INFO: `/v3/users` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.311913 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.313863 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.336388 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1460/2889] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 25 05:57:19 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:57:19.340663 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.352670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be028f-be3e-49c5-935c-a5d8166d8685 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.357633 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.358306 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.358586 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.359140 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.360025 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.361732 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.374012 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1430/2890] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:57:19.378912 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.389986 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a81b9-4847-4b18-9132-b68a4e71ff53 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.394674 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.395611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.395896 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.396175 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] PATH_INFO: `/v3/projects/95849a5ea7414919960c6b94ac62e923/users/ca1b19569fd84eb3b253e5a50bef1f63/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.412131 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95849a5ea7414919960c6b94ac62e923, user_id=ca1b19569fd84eb3b253e5a50bef1f63, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.414809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.429478 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1461/2891] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:19 2022] PUT /identity/v3/projects/95849a5ea7414919960c6b94ac62e923/users/ca1b19569fd84eb3b253e5a50bef1f63/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:19.434144 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.445261 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9a889-997a-4c97-a4f8-0f33af5de2b6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.467484 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:19.509535 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.510215 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.510500 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.510777 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] PATH_INFO: `/v3/roles` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.511544 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.513148 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8524439-9bff-4f31-971d-6896a847dcab admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.524421 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1431/2892] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 25 05:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:57:19.528741 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:19.534566 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:19.540964 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66267673-2d79-46fb-bdc8-d0541511659e admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:19.545989 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:19.546868 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:19.547206 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:19.547484 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] PATH_INFO: `/v3/projects/95849a5ea7414919960c6b94ac62e923/users/ca1b19569fd84eb3b253e5a50bef1f63/roles/ec6fc519ac424429b222f0d66bf7dc74` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:19.549962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95849a5ea7414919960c6b94ac62e923, user_id=ca1b19569fd84eb3b253e5a50bef1f63, role_id=ec6fc519ac424429b222f0d66bf7dc74)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:19.552746 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:19.562971 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1462/2893] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 25 05:57:19 2022] PUT /identity/v3/projects/95849a5ea7414919960c6b94ac62e923/users/ca1b19569fd84eb3b253e5a50bef1f63/roles/ec6fc519ac424429b222f0d66bf7dc74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:57:24.243572 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5016-140b-4756-bfa6-b4079109a891 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:24.244176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5016-140b-4756-bfa6-b4079109a891 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:24.244176 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5016-140b-4756-bfa6-b4079109a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:24.278741 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-8ffe5016-140b-4756-bfa6-b4079109a891 None None] MFA Rules not processed for user `ca1b19569fd84eb3b253e5a50bef1f63`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:24.280293 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-8ffe5016-140b-4756-bfa6-b4079109a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:24.370158 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1432/2894] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:57:24.387222 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:24.391070 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:24.493645 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500910fc-0c1f-4428-a516-191bf4525f63 admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:24.499906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:24.499906 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:24.500171 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:24.500359 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:24.566526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:24.568462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:24.578759 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1463/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:25.524253 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:25.524795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:25.524795 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:25.543570 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] MFA Rules not processed for user `5826fea6410645609a2fac7ce8376c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:57:25.544839 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:25.552661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1433/2896] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 25 05:57:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:57:34.574294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:35.538055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=55 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:38.275184 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:38.276719 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:38.349020 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59143f-c7aa-404a-8c8a-3644d13973c2 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:38.353962 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:38.354611 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:38.354893 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:38.355193 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:38.356936 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:38.368876 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:38.370554 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:38.381440 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1464/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:40.016170 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:40.079247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511987-66af-4d15-b77d-008b6c567ed1 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:40.083098 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:40.083778 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:40.084060 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:40.084337 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:40.086151 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:40.097220 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:40.098673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:40.107262 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1434/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:45.973120 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:45.986072 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3b12-caa7-499e-910e-2e7efa8244fa service placement] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:45.991996 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:45.992652 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:45.992980 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:45.993256 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:45.995029 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:46.007818 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:46.009402 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:46.020945 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1465/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:48.175027 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:57:48.176487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:57:48.186625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163670ef-e855-479a-a16e-ba0a50c24721 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:57:48.190810 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:57:48.191466 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:57:48.191744 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:57:48.192016 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:57:48.201116 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:57:48.202532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f139-8308-4e21-a1ba-7657fe984385 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:57:48.212050 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1435/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:57:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:57:56.015729 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=38 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:58.207896 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=32 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:58:43.606189 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:58:43.607660 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:58:43.622602 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793d387-2a5e-4908-8eef-e304f5944232 service nova] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:58:43.627581 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:58:43.628919 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:58:43.629240 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:58:43.629526 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:58:43.631301 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:58:43.642701 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:58:43.644330 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42a97-f412-4b6b-ac57-8d215058db58 service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:58:43.654694 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1466/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:58:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:58:53.650337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=6 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:57.263514 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9484-c010-4bd0-b10e-085f656c0d0f None None] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:57.264110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9484-c010-4bd0-b10e-085f656c0d0f None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:57.264110 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9484-c010-4bd0-b10e-085f656c0d0f None None] PATH_INFO: `/` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:57.265630 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1436/2902] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:59:57.273615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1c34-67ff-478b-8c22-7edb7274e857 None None] REQUEST_METHOD: `POST` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:57.274094 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1c34-67ff-478b-8c22-7edb7274e857 None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:57.274204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a1c34-67ff-478b-8c22-7edb7274e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:57.323583 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.auth.core [None req-d00a1c34-67ff-478b-8c22-7edb7274e857 None None] MFA Rules not processed for user `24c8c936a12441ba81ace37b997ac0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:59:57.324810 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-d00a1c34-67ff-478b-8c22-7edb7274e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:59:57.331480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1467/2903] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:59:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 05:59:57.346393 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9484-c010-4bd0-b10e-085f656c0d0f None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:59:57.359248 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9484-c010-4bd0-b10e-085f656c0d0f None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:59:57.362724 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:59:57.364028 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:57.364305 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:57.364583 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:57.372034 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:59:57.373445 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdbcc4-e5e3-46f0-8a2f-a581cc0ac759 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:59:57.381418 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1437/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:59:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 05:59:58.481782 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3074-df7e-4319-a794-22993b63643b None None] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:58.482239 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3074-df7e-4319-a794-22993b63643b None None] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:58.482355 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d3074-df7e-4319-a794-22993b63643b None None] PATH_INFO: `/` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:58.484593 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1468/2905] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:59:58.490178 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] REQUEST_METHOD: `POST` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:58.490661 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:58.490879 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:58.528209 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.auth.core [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] MFA Rules not processed for user `e82ecd4a337d4c088cf4a45d8c49534a`. Rule list: `[]` (Enabled: `True`). {{(pid=86779) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:59:58.529415 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:59:58.539029 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1438/2906] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 05:59:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 05:59:58.549705 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d3074-df7e-4319-a794-22993b63643b None None] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:59:58.561371 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d3074-df7e-4319-a794-22993b63643b None None] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:59:58.565198 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:59:58.565877 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:59:58.566162 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:59:58.566465 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:59:58.577809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:59:58.579265 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:59:58.590204 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1469/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 05:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:08.525835 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=15 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:08.585480 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=19 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:21.183402 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:21.195068 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53daf3-68ca-4130-879a-eb20e965dd85 None None] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:21.201605 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e82ecd4a337d4c088cf4a45d8c49534a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:21.202302 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:21.202532 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:21.202821 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:21.204673 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:21.218686 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:21.220315 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:21.232354 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1439/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:21.383456 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:21.392213 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081c454-8d87-4f54-a7bd-f71ea81584df service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:21.396157 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:21.396796 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:21.397079 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:21.397360 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:21.400011 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:21.413809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:21.416168 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:21.429571 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1470/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:22.605218 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:22.614903 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5492b-8e9c-4b25-aef7-873a6b7122d6 service nova] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:22.619288 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24c8c936a12441ba81ace37b997ac0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:22.619937 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:22.620219 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:22.620498 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:22.622289 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:22.635805 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:22.637224 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:22.648595 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1440/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:28.202327 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:28.214450 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b482e0-cedb-42ff-8a0b-af548af75eb3 service neutron] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:28.219615 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:28.220294 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] REQUEST_METHOD: `GET` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:28.220570 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:28.220851 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:28.222640 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:28.235176 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:28.236910 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:28.250123 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1471/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:31.165599 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:31.238705 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a185-1d9c-48df-a744-368375030a50 service neutron] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:31.243929 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:31.244808 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:31.245086 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:31.245360 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] PATH_INFO: `/v3/users/5826fea6410645609a2fac7ce8376c1e` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:31.246536 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5826fea6410645609a2fac7ce8376c1e)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:31.248487 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:31.294247 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5826fea6410645609a2fac7ce8376c1e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.294901 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5826fea6410645609a2fac7ce8376c1e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.301910 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5826fea6410645609a2fac7ce8376c1e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.309405 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5826fea6410645609a2fac7ce8376c1e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.320921 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5826fea6410645609a2fac7ce8376c1e'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.326736 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1441/2912] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 06:01:31 2022] DELETE /identity/v3/users/5826fea6410645609a2fac7ce8376c1e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:01:31.500469 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:31.514140 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d5e72-4939-4953-b7d7-44f9381eea80 service placement] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:31.571664 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:31.572529 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:31.572809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:31.573082 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] PATH_INFO: `/v3/projects/ad09eb68f3f04c89bd1fd9d60583edb6` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:31.574247 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad09eb68f3f04c89bd1fd9d60583edb6)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:31.576220 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:31.621809 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad09eb68f3f04c89bd1fd9d60583edb6', 'request_id': 'req-b6ada76b-1380-4a5e-afc0-826d286f4aaf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.628872 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad09eb68f3f04c89bd1fd9d60583edb6', 'request_id': 'req-b6ada76b-1380-4a5e-afc0-826d286f4aaf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.634337 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad09eb68f3f04c89bd1fd9d60583edb6', 'request_id': 'req-b6ada76b-1380-4a5e-afc0-826d286f4aaf'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.645062 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] The token cache is being invalidate because project ad09eb68f3f04c89bd1fd9d60583edb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:01:31.645345 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.645965 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.647899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1472/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 06:01:31 2022] DELETE /identity/v3/projects/ad09eb68f3f04c89bd1fd9d60583edb6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:01:31.652075 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:31.653550 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:31.667273 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba9be-5e51-4733-a53e-fd59cdc21b46 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:31.714395 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:31.724643 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:31.725507 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:31.725784 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:31.726055 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] PATH_INFO: `/v3/users/ca1b19569fd84eb3b253e5a50bef1f63` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:31.727955 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1b19569fd84eb3b253e5a50bef1f63)` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:31.729852 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:31.773069 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1b19569fd84eb3b253e5a50bef1f63'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.774378 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1b19569fd84eb3b253e5a50bef1f63'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.781731 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1b19569fd84eb3b253e5a50bef1f63'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.788506 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1b19569fd84eb3b253e5a50bef1f63'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.800636 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.notifications [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1b19569fd84eb3b253e5a50bef1f63'} {{(pid=86779) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:31.806443 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1442/2914] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 25 06:01:31 2022] DELETE /identity/v3/users/ca1b19569fd84eb3b253e5a50bef1f63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:01:31.975462 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Authenticating user token {{(pid=86778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:31.977856 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.fernet_utils [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:31.993704 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada76b-1380-4a5e-afc0-826d286f4aaf admin admin] Validating token access rules against request {{(pid=86778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:32.051112 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07b3e7435f2b475f9f928da267cae759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14668381bc465f992daab174b77fd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:32.051998 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:32.052279 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:32.052555 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] PATH_INFO: `/v3/projects/95849a5ea7414919960c6b94ac62e923` {{(pid=86778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:32.053723 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95849a5ea7414919960c6b94ac62e923)` {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:32.055764 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] RBAC: Authorization granted {{(pid=86778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:32.061923 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:32.105899 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95849a5ea7414919960c6b94ac62e923', 'request_id': 'req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:32.113200 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95849a5ea7414919960c6b94ac62e923', 'request_id': 'req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:32.119412 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95849a5ea7414919960c6b94ac62e923', 'request_id': 'req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75'} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:32.130434 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] The token cache is being invalidate because project 95849a5ea7414919960c6b94ac62e923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:01:32.130717 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:32.131389 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG keystone.notifications [None req-112ff66f-fcf8-4e6e-b873-93d75ecf3e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:01:32.133437 dv-cinder-850831-1-smb devstack@keystone.service[86778]: [pid: 86778|app: 0|req: 1473/2915] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 25 06:01:31 2022] DELETE /identity/v3/projects/95849a5ea7414919960c6b94ac62e923 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:01:41.802969 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:42.127362 dv-cinder-850831-1-smb devstack@keystone.service[86778]: DEBUG dbcounter [-] [86778] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:48.583883 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Authenticating user token {{(pid=86779) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:48.585407 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:48.724278 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadbca2-232c-4390-a6da-a130c9527cb6 admin admin] Validating token access rules against request {{(pid=86779) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:48.781991 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e5ad200c9f4c00b971765eff2b194a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c8f94b507e48319424d3a1166b5e35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86779) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:48.782638 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] REQUEST_METHOD: `GET` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:48.782920 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] SCRIPT_NAME: `/identity` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:48.783228 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86779) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:48.785644 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.fernet_utils [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86779) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:48.796625 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:48.798188 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da30e6-318a-48f4-9280-a4fe162eefae service placement] RBAC: Authorization granted {{(pid=86779) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:48.808670 dv-cinder-850831-1-smb devstack@keystone.service[86779]: [pid: 86779|app: 0|req: 1443/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:58.804366 dv-cinder-850831-1-smb devstack@keystone.service[86779]: DEBUG dbcounter [-] [86779] Writing DB stats keystone:SELECT=89 {{(pid=86779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}